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Aspects of Cohesion and Coherence in Context: Investigating Causes of 
Difficulty for Israeli University Students Reading Texts in English 

Marsha Bensoussan 

CHAPTER ONE 

PROBLEMS OF ISRAELI UNIVERSITY STUDENTS IN READING ENGLISH 

A. IDENTIFYING FACTORS CAUSING TEXT DIFFICULTY 

First-year students at Israeli universities are required to read many 
of the same academic articles and texts in English as any freshman college 
student would be reading in the USA or England* Some of these texts are 
difficult for students vrtio are native speakers of English. The difficulties 
are compounded for our students, for whom English may be their second 
language (for native speakers of Hebrew) or third (for native speakers of 
Arabic) . 

It is not clear why students find certain texts more difficult than 
others. Many teachers and students believe that having a limited vocabulary 
is a major obstacle to reading comprehension. Yet it is possible to 
mderstand every word separately in a sentence without understanding either 
the meaning of the sentence as a whole or its function in the text. 
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CHAPTER ONE 2 

Early research tried to measure text difficulty by using readability 
formulas, quantifying the surface structure of samples of the text by means 
of factors such as word length and sentence length. Although these 
readability formulas solved the problem of quantifying the variety of 
factors in a text t they did not really explain these factors. Nor were 
the formulas reliable for advanced texts in English. One of the shortcomings 
of readability formulas is that they cannot explain why certain texts would 
be difficult for some readers, but relatively easy for others. 

More rocent research in psycholinguistics examines the structure and 
content of the vhole text or discourse rather than selected samples of it. 
Those aspects of a series of sentences or utterances which cause it to be 
seen as a whole connected discourse are said to give it 'coherence. 1 Most 
of these aspects are implicit in the text, without special signalling. For 
the purposes of this study, only one aspect of coherence will be investigated: 
the aspect dealing with the way in whi^ch a written discourse is shaped by 
the sequencing of its sentences. The meaning and rhetorical function, or 
illocutionary force, of a sentence may be affected by the meaning of 
sentences preceding and following it, or by its placement in the discourse 
(i.e., The weight of a sentence may differ depending on whether it appears 
at the beginning or the end of the discourse. 

To understand the meaning of a sentence in context, readers need to 
arrive at an understanding of the coherence of the text — the reasoning 
behind the purpose and placement of a particular sentence in the text. A 
closer look at the larger context preceding and following a problematic 
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sentence yields more information about the content and author's intentions 
in the tett. 

Sometimes the links betwsen ideas in a discourse are overtly signalled 
(e.g., pronouns, repetition, synonyms). The writer explicitly states the 
connection between sentences by words which serve as signposts of the 
structure of the discourse. Such words are termed markers of 'cohesion. 1 
Examining the sentences for markers of cohesion may help readers to a 
certain extent. 

The terms 'coherence' and 'cohesion 1 will be used in this study as 
points of reference in a discussion of reading difficulty. It must be 
borne in mind that these terms will be used as a kind of shorthand since 
this study will deal only with selected aspects of coherence (sequencing 
of information) and cohesion (reference, substitution, ellipsis, and lexical 
cohesion). It is assumed that in order to comprehend a text, students 
must know not only the meaning of the separate words but also have a sense 
of how the text coheres as a whole and what cohesive devices the writer 
uses to signal organization of the information. 

The extent to which advanced readers at the university level aro 
capable of understanding the coherence and cohesion of a text will be 
investigated in this study. A diagnosis of areas of difficulty would 
examine whether ? student has understood the relations between words, 
between sentences, between paragraphs, and among ideas in the text as a 
whole. 
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There are other, non-linguistic, factors that need to be taken into 
account. Inasmuch as reading comprehension depends on the reader as much 
as it does the text, the spec if ic problems of Israeli students will also 
be examined as causes of difficulty. Recent research assumes that readers 
come to a text with certain expectations. Thus if a certain text does not 
fulfill readers' expectations, then they may find the passage difficult 
to read and understand. 

This study will deal only with expository texts, a text-type with 
which univerity students are familiar from their Hebrew studies. Although 
fluent readers may know what to expect from an expository text on the 
macro- (i.e., global, whole-text) level which includes ideas- and the facts 
and examples which the writer uses to prove his argument(s) , students do 
not necessarily know what to expect on the micro- (i.e., paragraph, sentence, 
and word) level. According to this reasoning, the problems for Israeli 
students may be lack of familiarity with the conventions and organization 
of English prose (coherence and cohesion of the discourse), as well as 
unfamiliar ity with the vocabulary in any given text. 
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B. TEACHER AND STUDENT ATTITUDES TOWARD COHERENCE AND COHESION 

1. Previous Resecrch on Opinions of What Hakes Texts Difficult 

a. E FL Student Opinions 

Researchers in the field of reading comprehension for students of 
English as a Foreign Language (EFL) asked the opinions of their students, 
and there was agreement as to the cause of greatest difficulty: by far 
the most students believed that their main obstacle to reading comprehension 
was lack of vocabulary (Yorio 1971, Gorman 1979, Sim 1979). 

There was disagreement, however, concerning what students saw as their 
next worst problem. Gorman (1979) quoted research pointing to problems 
with syntax. Sim (1979) found that many students complained about difficulty 
with sentence structure and length. Another group of students questioned 
by Sim (1979), however, complained that they had difficulty following ideas 
because they did not always see how these were joined. Yorio (1971) also 
found that, as the second greatest problem, students feared that they too 
easily lost the thread of an argument. For these two groups of students, 
then, sentence structure may not be as much of a problem as the connection 
between sentences. 

Other problems noted by students were interference by the native 
language (Yorio 197D; style, level of abstraction, content of subject 
matter, and text length (Sim 1979); and rate of reading (Gorman 1979). 
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b. Lecturers 1 Opinions 

Sim (1979) also questioned lecturers in the Department of Sociology 
as to what they thought were the major causes of reading difficulty for 
their students. Again vocabulary was seen as the leading obstacle to 
reading comprehension. 

2. Questionnaires at Haifa University (For a copy of the 
Questionnaire, see Appendix A) 

Before carrying out the empirical studies, I took a preliminary survey 
to learr the opinions of students and teachers of EFL at Haifa University 
(and by implication, other Israeli EFL students and their teachers at the 
university level) concerning certain aspects of coherence and cohesion 
more specifically. In particular, we were interested in three features 
which will be examined in detail: 

1. inference, implication (B9) —indirect illocutionary 
force 

2. contextually synonymous paraphrase (C2) — lexical 
cohesion: recognition of word, paragraph equivalents 

3. reference (D4) — grammatical cohesion 

Inference/ implication (indirect illocutionary force) is one aspect 
of coherence, synonyous paraphrase is one aspect of lexical cohesion, and 
reference is one aspect of grammatical cohesion. Thus each of these 



ERLC 



15 



CHAPTER ONE 7 

features represents one of the aspects with which this study will deal. A 
questionnaire was distributed for students and teachers of all levels of 
English courses, ranging from the Pre-Academic Unit to the Department of 
Foreign Languages. The questionnaire consisted of a checklist of features 
causing difficulty in reading comprehension. The three items of special 
interest were included in a total list of 41 items which appeared under 
six headings: Graphic Organization, Rhetorical Devices or Argumentation, 
Vocabulary, Syntax and Grammar, Author's Involvement in the Text, 1 and the 
Reader's Attitude and Self-Confidence. EFL students and teachers were asked 
to rate the six headings both in order of importance and in order of 
difficulty. In addition, they were asked whether or not each of the 41 
items was taught, was seen as important, and was considered to cause 
difficulty in reading. 

a. EFL Students 1 Opinions 

Results were obtained from 105 students of EFL: 67 studying in the 
required English course in the Department of Foreign Languages and 38 at 
the IVe-Academic level (21 B level and 17 C level students). They answered 
questionnaires written in English. Terms that were not clearly understood 
were translated to the class orally by the researcher or teacher who 
administered the questionnaires. Students differed in their opinions of 
which features were more important and more difficult. The hierarchies 
are shown in Tables 1-4, Appendix A. 
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In general, students rated difficult and important features almost 
in the same order. The three features seen as easier (i.e., author's 
involvement, reader's attitude, and graphic organization) were also seen 
as less important. On the other hand, there was some discrepancy for the 
features seen as more difficult and more important. Vocabulary was viewed 
as most difficult by all students, but most important by only the weaker 
ones. For the more proficient, vocabulary was second in importance to 
syntax/grammar (including reference). Rhetorical function, considered 
second most difficult, rated third in importance. Syntax/ grammar rated 
third in difficulty but higher in importance. 

Focusng on the three features of lexical cohesion, grammatical cohesion, 
and indirect illocutionary force, we came to the following conclusions: 

1. These features were taught in class with varying 
frequency. 

2. These features were believed essential to reading 
comprehension by more than half the EFL Pre-Academic 
students and important but not essential by more than 
half the Required Course students. 

3. These features were considered either extremely or 
fairly difficult (except for synonymous parahrase, which 
one-third of the Required Course students found fairly 
easy). 
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4. Although syntax/grammar (reference) was believed 
difficult, students did not perceive this feature as 
being taught in class often. 

In short, students perceived these features as being both fairly 
difficult and important for reading. Yet students did not see these 
features as being particularly emphasized in class. The fact that students 
believed these features to be difficult and important in the reading process 
indicated that an investigation of these topics would be worthwhile. The 
fact that such featires were not seen as being emphasized in the classroom 
was puzzling. It implied either that teachers did not view these features 
as important and/or difficult, or else that students did not notice when 
these features were taught. Questionnaires were therefore also distributed 
to EFL teachers. 

b. EFL Teachers' Opinions 

Results were obtained fVon 16 teachers of EFL: ten in the Pre- Academic 
Unit, six in the Department of Foreign Languages, and one teacher of 
student-teachers of EFL in the Department of Education, Haifa 
University. 2 

Of the three features exanined on the questionnaire (infe* ice/ implication, 
synonymous paraphrase, and reference), the following results were 
obtained: 
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1. These features were always taught in class. 

2. These features were believed to be essential reading 
comprehension by more than half the teachers. 

3. Implication/inference (indirect lllocutionary force) 
was considered extremely difficult by teachers of the 
weaker classes. Teachers of more advanced classes 
considered it to be only fairly difficult for 
students. 

4. Opinion concerning the other two features was split 
between fairly difficult and fairly easy. That is, 
although many of the teachers saw features of cohesion 
important enough to teach in class, they did not perceive 
these features as specific causes of reading 
difficulty. 

5. Vocabulary and Syntax/Grammar were considered to have 
the same level of difficulty and to be of equal 
importance. 

In short, although many EFL teachers perceived these features as being 
essential to reading comprehension, they did not necessarily believe these 
features to impede comprehension. And they claimed to always teach these 
features in class. Thus EFL students and teachers differed as to how they 
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perceived these features in terms of difficulty, importance, and classroom 
attention. 

c. Discrepancies between Views of EFL Students and Teachers 

An examination of these tables shows that there are discrepancies 
between which features EFL students and teachers perceive as difficult, 
as important, and as being emphasized in the classroom. 

1. Whereas students viewed vocabulary as most difficult, 
teachers placed it lower down the hierarchy. 

2. Students saw author's involvement as not so difficult, 
whereas it was the most difficult feature, according to 
EFL teachers. 

3. Many teachers recognized the importance of the reader's 
attitude and self-confidence in the classroom, whereas 
for students it was at the bottom of the hierarchy. 

4. Although teachers believed that certain features were 
always taught in class, students perceived them as only 
appearing often or sometimes in the lessons. 

5. Students believed features of coherence and cohesion 
more difficult than teachers considered them to be. 
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6. Students considered vocabulary more difficult than 
syn tax/ grammar f whereas teachers considered them to be 
on the same level of difficulty. 

These findings underscore a point that we suspected at the beginning 
of the research. Although EFL teachera recognize the importance of certain 
aspects of cohesion and coherence in reading comprehension, they may not 
believe that these features may be causes of difficulty. The students 
themselves, on the other hand, appear to see them as troublemakers. This 
study will investigate whether these features cause difficulty and, if so, 
will suggest means by which EFL teachers can help their students overcome 
these obstacles to comprehension. 
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C. AIMS OF THE PRESENT STUDY 

One aim of this study will be to examine two aspects of discourse - 
- coherence and cohesion — using a number of texts to determine how and/or 
whether these features cause difficulty in reading comprehension for 
advanced Israeli students of EFL. 

In addition, this study will examine alternative methods of evaluating 
difficulty of texts, and the advantages and disadvantages of each. One 
of the problems in discussing reading difficulty is that it cannot readily 
be quantified and measured. 3his research effort* will* rely on more than 
one experimental procedure in order to measure selected features of coherence 
ana cohesion affecting reading difficulty. For example, multiple-choice 
questions will be asked about specific sections of text. Tf students have 
difficulty answering these questions, then the text will be examined to 
see whether the difficulty was due to any particular features of coherence 
or cohesion. A number of different approaches on a variety of texts will 
be used: a readability formula, multiple-choice comprehension questions, 
and modified rational cloze procedure. 

D. RESEARCH QUESTIONS 

During the course of this study, the following questions will be 
investigated: 

1. Is coherence a factor that may affect reading comprehension? Does 
a certain sequence of information cause more difficulty in comprehension 
than another? 
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We will exanine the hypothesis that the sequence in which information 
appears may affect the reader's perception of rhetorical functions (see 
below, Illocutlonary Acts , Chapter TWo B. 1.d.3)t pp. 23-24). It is assumed 
that a text containing paragraphs developed! according to a single line of 
thought is more likely to be more easily understood than a text containing 
shifting arguments and a variety of illocutlonary acts and sentence 
functions. In other words, it is assumed that not only the words themselves 
but the way they are organized may cause difficulty in reading. 

2. Do certain features of cohesion cause difficulty in reading 
comprehension? What is the relative importance of lexical as opposed to 
grammatical cohesion as obstacles to comprehension? 

We will also investigate the hypothesis that when students ignore or 
misconstrue markers of grammatical cohesion, they will be likely to find 
the text more difficult than if they are able to use these cohesive clues. 
It is assumed that students will find it harder to read the shorter, denser, 
more concentrated version of a text tfiich contains many items of grammatical 
cohesion, and will find it easier to read the longer version of the same 
text v*iich contains mostly items of lexical cohesion. This assumption is 
made in spite pf the fact that many of the items of lexical cohesion (e.g., 
synonyms, superordinates) may contain more varied and difficult vocabulary 
items than the version of text containing mostly items of grammatical 
cohesion (e.g., pronouns, ellipsis). 
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It is assumed that a text may be written and edited in various ways 
without changing the ideas presented in it. Alternative doctored versions 
were constructed for each text. Each version contained a large concentration 
of either items of grammatical or of lexical cohesion. 

The independent variables in th..s study will be the doctored versions 
of text and the test questions. The dependent variables were the students 1 
responses and total test scores. 



E. SIGNIFICANCE OF THE RESEARCH 

This study will attempt to present researchers with a variety of 
measures which may help to evaluate textual difficulty. It will try to 
isolate and measure complex textual features causing difficulty which, by 
their very nature resist quantification, unlike factors such as the number 
of words per sentence. 

Moreover, this study is intended to show the teacher of advanced EFL 
students which kinds of lexical or grammatical items are harder to understand 
than others, and how one aspect of coherence, the sequencing of ideas, may 
affect read*ility. This knowledge should help a teacher to determine the 
relative difficulty of a text before administering it to a group of students 
— without having to pre-test the text or having to count syllables or 
words per sentence, as is necessary according to many of the present 
methods. Instead, the teacher would scan quickly for markers of cohesion 
or features of coherence. 
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The results of this study may also be used by others engaged in 
preparing graded EFL materials, such as test constructors and textbook 
writers. This study will apply some of the findings of discourse analysts 
(Beaugranc*e f Halliday, Hasan, Searlc, van Dijk, and Widdowson) and 
psycholinguists (Bever, Carpenter, Carroll, Crothers, Garrod, Just, Kintsch, 
Sanford, Thorndyke, and Vipond) in an attempt to determine the significance 
of cohesion and coherence for these non-native speakers of English. 
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NOTES TO CHAPTER ONE 



1. The first five major categores were based on a checklist developed in 
the ESP seminar, English Department, the Hebrew University. The course 
was taught by Prof. Larry Sel inker and Prof. Andrew Cohen during the 
academic year 1976-1977. The list was compiled by Profs. Selinker and 
Cohen and the participants (approximately 25) in the seminar. For the 
purposes of this study, many of the sub-headings were changed, and one 
major category was omitted and another added in its place. 

In the Questionnaire the six subheadings of Author's Involvement in 
the Text were: purpose, audience, tone, degree of formality, which side 
of the argument (s)he is on (what argument?*), and evaluation and opinion. 
(See Appendix A, ) 

2. For contributing of their own time and that of their students, I wish 
to thank Eleanor Avinor, liana Bousso, Thilde Fox, Barbara Golan, Livia 
Goldenblatt, Melanie Kessler, Dr. Gita Kornfeld, Dr. Tsabelle Kreindler, 
Edith Krieger, Sandy Simenhoz, Batia Laufer, Ruth Nicola, Dr. Donald Sim, 
Ruth Sim,. Barbara Swirski, and Irma Zaslansky. 
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CHAPTER TWO 

A REVIEW OF PREVIOUS LITERATURE AND A RATIONALE FOR THE PRESENT STUDY 



This study will distinguish between two factors which affect text 
difficulty: the nature of the text and the capability of the reader. In 
Hasan's wards, "A text is a social agent." (1977, p. 229) This study will 
focus on two of the factors affecting text difficulty: the reader and the 
text. We will describe how text difficulty is defined and measured in the 
literature, and the effect of coherence and cohesion on text difficulty. 
In Sections A (pp. 18-21) and B (pp. 21-51) of this chapter, we will define 
the terms used in text analysis, focusing on speech act theory, discourse 
analysis, coherence, and cohesion, and produce a model of reading 
comprehension. In Section C (pp. 52-78), using these terms, we will discuss 
different hypotheses relating text analysis to the reading process. In 
Section D (pp. 79-96), we will describe methods used in the research to 
measure difficulty in reading comprehension. 

A. TEXT READABILITY 

1. Difficulty of Quantifying and Measuring Reading Comprehension 

One of the problems in discussing reading difficulty is that it may 
be quantified and measured in many ways. One reason for this is the very 
nature of the reading process itself which varies with readers and with 
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the circumstances in which they read a text (Klare 1963, p. 177). Beaugrande 
(1980) states that natural language communication is by nature n fuzzy tt (p. 
3). 

One way of approaching the subject of text difficulty is to equate 
it with the concept of readability. 

2. Quantification of Readability by Reading Formulas 

Readability formulas attempt to quantify and measure what are basically 
unquantifiable characteristics in a text: style, level of abstraction, 
difficulty of ideas (Dale and Chall 1948; Flesch 1950; Klare 1952, 
1963). 

More than thirty readability formulas are cited by Klare (1963). They 
are based on the following criteria: 

a. word factor 

1 ) word length 

2) word familiarity 

3) grammatical classification 

b. sentence length 

It is claimed that these formulas are fairly accurate in rating texts 
according to grade level. Klare (1963) cites evidence of formula validity 
from three sources: comparison with Difficulty Indices on criterion passages, 
high correlations between formula scores on the same passage, and studies 
relating formula scores to some outside criteria of readability. 
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Bormuth (1966) claims: 

a single readability formula can be usd to predict 
difficulty for subjects at almost any level of reading 
ability, (p. 126) 

He reports high correlations between readability formulas and cloze 
passages. 

The formula that was chosen to be used in this study is the Flesch 
Reading Ease Readabllty Formula (Klare 1963, pp. 23, 53-59). This formula 
is cited as being often used, easily applied, and having much research 
data available. The equation for this formula is as follows: 

Reading Ease = 206,835 - .846 wl - 1.015 si 
wl = the number of syllables per 100 words 
si s the average number of words per sentence 

This formula was applied to the first 100 words of each of the texts used 
in this study. 

Readability formulas, however, deal only with the surface structure 
of a text (for discussion of disadvantages, see below D. 1., pp. 79-83). 
The underlying textual relations between ideas in the text can be measured 

in other ways, especially since formulas are not very reliable on the advanced level # 
A variety of methods will be used in this study to evaluate text 
readability. We will begin by discussing discourse analysis. Like the 
readability formulas, discourse analysis can be used to examine segments 
of text larger than the sentence. Unlike formulas, which reduce the 
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readability of a text to a single number representing a grade level, 
discourse analysis is a technique whereby a text can be described in terms 
of various conceptual and structural elements. 

B # TEXT ORGANIZATION; DISCOURSE ANALYSIS 
1. The Realization of Meaning as Text 
a. Meaning — Speech Act Theory 
1 ) Utterances 

Meanings are communicated by utterances, which are defined by Fries 
095*0 as "the total span of talk of one person in a single conversation 
or discourse." Here the meaning of discourse is limited to a single 
exchange in conversation. Later linguists (Coulthard 1977, Widdowson 1978, 
1979) speak of discourse as a series or sequence of utterances. 

According to Corder (1973), 

utterances ... are situationally conditioned realizations 
of sentences, (p. 91) 

Take, for example, the following sentence from Text 2 (see Appendix 

B): 

(1) Last year the world's population passed 4 billion. 

30 
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This sentence could be encountered either as a single independent utterance, 
or as part of an utterance in a larger context. 

The linguistic meaning of utterances, according to Fries (1954), has 
two components: lexical and structural. Examining our sample sentence 
as a complete utterance, we find its meaning both from the individual 
word meanings and from the relations among these words in the sentence 
framework. Set in a different order, the same words would have a different 
(nonsense) effect: 

The 4 billion population passed the world's last year. 

Thus both lexical and structural meanings are vital to comprehension. Moreover, an 
utterance contains both propositions! content and illocutionary force (see 2) Propositions 
and 3) Illocutionary Acts below). 

2) Propositions 

Van Dijk (1980) defines propositions as "conceptual structures that are the minimal 
bearers of truth or satisfaction" (p. 207). Clark and Clark (1977) nota that prepositional 
content is also called "ideational content" with one of three basic functions: to denote 
states or events; to denote facts about states or events; or to qualify parts of other 
propositions" (p. 29). For our sample sentence (l) above, the function of the propositional 
content is to denote a fact about the number of people in the world last year. 
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3) Illocutionarv Acts 
The tern "lllocutionary act" in the lexicon of discourse analysis originated with 
Austin (1962) and Searle (1968, 1969). Sone present day linguists equate illocutionaiy 
acts with speech acts (Brown 1976, Levy 1979, Bever and Townsend 1979), but speech acts ; * 
usually appear in social contexts, whereas illocutionary acts often refer to written discoux^ 
lllocutionary force is seen by Widdowson (1979) to be the realization ^ 
of the 1 meaning potential 1 of the proposition expressed. * - 

Thus the illocutionary force of a particular utterance 
is seen to be a functional reflection of its intrinsic 
linguistic form. (p. 127) 

Illocutionary force may also be considered as the function of speech acts 

(Brown 1976). 

Looking again at our sample sentence (1), we may find a wide variety 
of possible illocutionary forces for this sentence, depending on the whole 
utterance or wider context. The sentence may be a dry statement of fact, 
a comparison between last year and previous years, a warning of impending 
danger, the cause for some effect mentioned elsewhere in the text, etc. 
The illocutionary force of an utterance depends on the writer f s 
intention. 

Together, propositional content and illocutionary force constitute 
the message of an utterance. According to Schlesinger ( 1 977 ) t "There are 
two aspects to the message conveyed by a speaker 11 : the propositional 
contexts and communicative considerations including illocutionary force 
(p. 79). Widdowson (1979) explains: 
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One needs to recognize that linguistic structures are 
expressive of certain propositions on the one hand and 
that they count as performances of certain illocutionary 
acts on the other, (pp. 119-120) 



4) Discourse 



Discourse has been defined by Marshall and Clock (1978-79) as "the 
linguistic term used to define any utterance, regardless of length, that 
is a complete unit of meaning and has cohesion or unity" (p. 14). 

Widdowson (1978) explains how discourse involves propositions or 
illocutionary acts: 



The description of discourse involves in part the way 
propositions combine to form an ongoing development: but 
it also involves accounting for the illocutionary acts 
these propositions are used to perform, and how they are 
related to each other, (p. 27) 

The deep structure of a message (referred to by Marshall and Clock 
(1978-79) as the semantic structure), defined as a sequence of utterances, 
can be analyzed either as a sequence of propositions or as as sequence of 
illocutionary acts; in each case the sequence of units is seen as discourse. 
Both the propositional content and the illocutionary force of a text are 
taken into account in a full analysis of discourse (Cicourel, 1980, p. 
102). On the level of surface structure, however, we have sequences of 
sentences v*iich combine into texts (van Dijk 1972, Coulthard 1977, Widdowson 
1978 and 1 979 ) • This dichotomy between deep and surface structure is also 
made by Halliday (1978): "Meaning is encoded as wording; and wording, in 
turn, as speaking or writing" (p. 208). Thus meaning on the deep level 
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becomes encoded and finally emerges on the surface level as speaking or 
writing. 

b. Meanings Encoded as Text 
1) Text 

The term text has been defined in a number of ways. According to 
Halliday and Hasan ( 1976), "Any piece of language that is operational, 
functioning as a unity in some context of situation, constitutes a text" 
(p. 293). Halliday (1978) describes a text as: 

a xind of 1 super sentence, 1 a linguistic unit that is in 
principle greater in size than a sentence but of the 
same kind. (p. 109) 

Beaugrande (1980) defines a text not as a series of single sentences, 
but as "meaningful configurations of language intended to communicate" (p. 
1). He continues by saying that a text is an "actual system" (p. 16) 
created from the potential language system. In the same vein, Halliday 
and Hasan ( 1 976) explain: "A text does not CONSIST OF sentences, it is 
REALIZED BY, or encoded in, sentences" (p. 2). Halliday (1978) is more 
specific : 

A text is 'what is meant 1 , selected from the total set 
of options that constitute what can be meant. In other 
words, text can be defined as actualized meaning potential, 
(p. 109) 
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2) Meanings and Their Surface Manifestations 

o n ^-t d/icoursc /«**■' 
A distinction is often made between meanings A (e.g., ideas, utterances, 

propositions, deep structure) and their surface forms or manifestations 
or +tyfs 

in sentences (Brown 1976, p. 387; Wilkins 1976, p. 10). 

In a written text t utterances are realized in sentences. There is 
no one-to-one correspondence, however, between one utterance and one 
sentence (Brown 1976, Coulthard 1977, Clark and Clark 1977, Widdowson 1978 
and 1979). (See above B.l.b.1), Text, p. 25.) Van Dijk (1972) explains 
the differences clearly: 

Notice however that SENTENCES, strictly speaking, 
are formal constructs of grammar and not empirical 
entities .... Tn performance speakers are dealing with 
UTTERANCES, ffowever, there are no a priori or empirical 
reasons for maintaining that the formal linguistic unit 
underlying such utterances should necessarily be the 
sentence .... As a matter of fact we know that most 
utterances 1 consist of f more than one uttered sentence, 
viz. a sequence of sentences. Such sequences are often 
referred to as f discourse f or f pieces of discourse 1 , (p. 
3) 

Tn this study we will preserve this distinction between sentences and 
utterances. 

Propositions, like utterances, are expressed by sentences (Grimes 
1971, Wilkins 1976, Clark and Clark 1977, Widdowson 1978 and 1979, Marshall 
and Glock 1978-79, van Dijk 1980). Similarly, there is no one-to-one 
correspondence between one proposition and one sentence. A sentence may 
contain more than one proposition, or conversely, a series of more than 
one sentence may form a proposition. In our analysis we distinguish, therefore, between 

the discourse level of meaning (propositional content and illocutionary force of each 
^ „ utterance) and the surface structure of a tfegt (realized in sentences). 
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3) Alternative Versions of Text 

In view of the notion that a text is an expression or a representation 

of propositions and illocutionary acts that are present at the level of 

deep structure c we may assume that different texts t representing alternative 

versions of a discourse, may be written. In other words, potentially, 

there are a number of texts that may be written to express the same ideas 

(Halliday 1971, Brown 1976, Lyons 1977, van Dijk and Kintsch 1977, Widdowson 

1980, Schnotz 1983). That is, alternative texts can be written containing 

the same propositions. Illocijtionary acts, however, may differ, 
depending cn the placement of the propositions in the text. 

Referring to Halliday's textual function of language, Widdowson (1980) 

explains that it is: 

the means whereby the language user organizes propo3itional 
content so that it is effectively conveyed ..... Its 
business is to provide alternative versions of propositions 
so that they are appropriate to the state of shared 
knowledge ... at a particular point in an interaction, 
(p. 236) 

In other words, there is no one-to-one correspondence between the 
ideas of the discourse, on the deep level, and their expression or realization 
in the sentence of the text, on the surface level. Moreover, some text 
versions may be more readable than others. (See below D. 3.C.2) The Technique 
of 'Doctoring 1 Texts , p. 92-93.) 
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4) Text vs. Context 

Thus we have a dichotomy between the discourse, or deep level meanings 
(i.e., concepts, notions, ideas) and their expression or realization as 
text on the surface level (Allen and Widdowson 197*0. According to van 
Wjk (1980), the former has contextual relevance and the latter has textual 
relevance: 

An element of a text is textually relevant if it is 
relevant with respect to other elements of the text and 
contextually relevant if it is relevant to elements of 
the communicative context (e.g., the pragmatic context), 
the cognitive context, or the social context, (p. 249) 

By this definition, contextual relevance includes non-linguistic as well 
as linguistic elements. This definition, however, is by no means accepted 
by all linguists (cf. Leech 1974, Haliiday and Hasan 1976 1 ). 

On the one hand, the use of alternative doctored text versions is 
based on the assumption that this distinction between the ideas in the 
text and the sentences through which these ideas are realized is valid. 
On the other hand, when discussing a word in context, it ts customary to 
refer to the words in the sentence which precede and/or follow the word 
in question. Thus, when applying linguistic theories to students' reading 
comprehension, one would be likely to deal primarily with the surface 
structure of the text. For this reason, in this study we will use the 
word "context" to include both the surface level structure and the deep 
level meaning. 
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One point that is agreed upon by linguists is that the meaning of a 
word, phrase, sentence, or discourse is affected by the context (Leech 
1974, van Dijk and Kintsch 1977, Candlin et al. 1978, Widdowson 1979, 
Cicourel 1980). In vew of this fact, it makes sense to extend the analysis 
of discourse beyond the sentence level* In this way one can focus on che 

relations between sentences and paragraphs, and on the structure of the 

f.vf ~* * uhoi* tkct tKe ^ Vendue* Wim" will *&>y +* Sendee 
text as a whole. n*"- 1 . , . . ' mj*-4l*+ u^tlt 

M-vcl, and *iUoc+tic»«y <f*r<i* +* ^ ^y^h *** wWe-*,T 

5) Beyond the Sentence 

Discourse analysis beyond the sentence level began with Harris (1952). 
Van Dijk (1972) also states that "sentence-based descriptions of the 
structures underlying utterances are inadequate" (p. 3). Meyer (1975) 
criticizes Chomsky for stopping at the sentence level: 



What is needed is an analysis procedure that classifies 
ideas in a passage not as subjects or verbs of individual 
sentences, but according to their role in conveying the 
total meaning of the passage, (p. 17) 



This analysis procedure is discourse analysis. One of the focuses of 
discourse analysis is the "topic" or "theme" of a text. 
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6) Topic, Theme, Paragraph-Level Concepts 



The well-known terms "topic" and "comment" are defined by van Dijk 
(1980): 



the notion of topic of a sentence is usually defined in 
terms of information that is already introduced ... t 
already supposed by the 'speaker to be known to the hearer 
or otherwise given or started from. The comment t then 
expresses or 'is 1 the information in the sentence that 
gives new, unknown , unpredictably etc., Information in 
relation to the topical information, (p. 9*0 

Topic ... is a semantic or a semantic-pragmatic notion. 
Second, a topic is not merely part of the semantic 
structure of a sentence but rather a function assigned 
to part of the semantic representation of a sentence. 
In other words, that part of the semantic representation 
that has a certain function is called the topic or has 
topic function. The same obtains for the notion of 
comment, (p. 95) 



What some linguists call "topic" may also be called "theme" by others. 
It may be based on surface structure and sequence (i.e., the first part 
of the sentence), as discussed by Halliday (196?, 1974, 1977) and the 
Prague-School's linguists who emphasize functional sentence perspective 
(see Danes 1974, Palkova and Palek 1977). Or "theme" may be defined in 
terms of ideas and content; Crothers (1979) defines "theme" as a term 
meaning "the propositions most central to the text's development" (p. 8). 
Chafe (1972), G-imes (1975), and Crothers (1979) draw a distinction between 
"theme" and its surface manifestation, if any, the "topic." It appears, 
however, that what they call "theme" is what van Dijk term3 "topic." 
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To avoid confusion, we will not use either the terms "topic* or 
"theme," because we are not interested in researching the topic- comment, 
theme-rheme, topic-theme distinctions. Instead, in this study we will use 
a global term, paragraph-level concepts , to refer to the major areas of 
prepositional content, or macro-propositions, appearing in the text. 
Paragraph-level concepts will include both topic and comment, both theme 
and rhese. 

7) Implication and Inference 

Another level of meaning that extends beyand the sentence is implication. 
Whereas the writer "implies" ideas, the reader "infers" them. Hence, 
implication and inference may be seen as two aspects of the same 
process. 

Crothers (1979) defines implication in the following way: 

Implication is the general term we will use here 
to include presuppositions, premises, and consequents 
.... The reason for seeking any one term at all is to 
contrast these three categories with purely referential 
inference of propositions, (p. 17) 

Brown (1976) states • 

in combination with the explicit text, it forms the 
complete, intended content of the speech act. Thus, the 
"presupposed text" is the direct embodiment of the 
relevant "context" of a language act." (pp. 338-339) 
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Widdowson (1979) goes so far as to give more importance to the 
implicit than to the overtly stated proposition in the text: 

With certain kinds of sentence, the overtly expressed 
proposition carries with it an additional covert proposition 
as a necessary concomitant. This second, covert proposition 
is said to be presupposed, (p. 120) ... it 1$ these 
covert, presupposed, propositions which control whether 
or not a sequence of sentences makes cohesive discourse, 
(p. 123) 

Other linguists (Jakobovits 1970, Brown 1976, van Dijk and Kintsch 
1977) agree that meaning or prepositional content is implied or encoded 
in text, and that this meaning may be expressed in a number of ways. It 
is also agreed that the context determining the interpretation of a 
particular word or sentence may extend beyond the level of the single 
sentence. In fact, sentence boundaries are not necessarily relevant to 
propositional content. 

Finally, it is agreed that meanings may be expressed both overtly and 
covertly. This study will examine whether the implication(s) of a sentence 
change(s) if it appears in another part of the text (i.e., If the order 
of the sentences is changed so that the context of certain sentences Is 
different) e (See below C.2.b.1)b) Order of Information: Sequencing of 
Propositions (Given/New), pp. 62-68.) 



, I Rjfc: 
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2. Coherence 



a. Definitions 



Coherence is not any easy term to define because there is disagreement 
as to its nature. Some linguists, in fact, attribute to it many of the 
characteristics of what we shall later refer to as Cohesion (See below 
B.3.a., pp. 39-40), and some linguists talk about Cohesion when they refer 
to what we will call Coherence. Nevertheless, there is some consensus 
among many linguists. In this study, we shall use the definition given 
by Langleben (1981): 



Coherence in its up-to-date sense is the capacity 
of a text to be consistent and interpretable. Any 'oext 
that is perceived as meaningful is also presupposed to 
be a coherent one. The meaningfulness of a text is 
apparently dependent on its coherency [sic] to such an 
extent that the latter seems to be the most influential 
factor contributing to the comprehension of the text, 
(p. 280) 

This definition is not quite complete, however. Brown (1976) includes 
the 

speaker and the hearer in his definition: 



the semantic linking which is the basis of discourse 
coherence and structure is referred back to its obvious 
source in meaning-choices made by speakers performing 
definite speech acts.... Hearers will recognize the 
discourse which results from such speech as unified by 
virtue of shared semantic content: propositional , modal 
and illocutionary content, respectively. Thus we define 
discourse coherence as a function of shared semantic 
content, (pp. 265-66) 
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Beaugrande (1980) oontinues the definition by including the means by which 
coherence is achieved: 

COHERENCE subsumes the procedures whereby elements 
of KNOWLEDGE are activated such that their CONCEPTUAL 
CONNECTIVITY is maintained and made recoverable. The 
means of coherence include: (1) logical relations such 
as causality and class inclusion; (2) knowledge of how 
events, actions, objects, and situations are organized; 
and (3) the striving for continuity in human experience, 
(p. 19) 

Elsewhere Beaugrande (1980a) states that coherence rests on a recurrence 
of semantic components, e.g., "semantic components" or "propositions" (p. 
290). 

Van Dijk (1980) enumerates the conditions by which sentences or 
propositions are connected or cohere. These conditions include: cause/reason, 
result/consequence, explanation, introduction, relations such as 
general-particular and whole-part, knowledge of the world (i.e., the ability 
to infer meanings from the text). More specifically, van Dijk explains 
that in a coherent text, certain speech acts are homogeneous, or belong 
together 1 , (p. 181) 

Less formally, Widdowson (1979) explains that coherence includes both 
illocutionary connections and propositions ( what communication and how the 
communication is achieved) (pp. 146-147). 

Van Dijk (1972) stresses that coherence accounts for the connectedness 
of discourse: 



The forma] concept of text, then, must account for 
the important empirical notion of COHERENCE: a native 
speaker is able to produce and interpret an utterance 
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f as a tfiole 1 , that is as a 'piece of CONNECTED discourse 1 f 
and not merely as a linearly ordered set discrete 
grammatical sentences, (p. 3) 

Ihe most concrete definition of coherence is given by Canale (1982): 

"the organization and unity of ideas in context" (p. 1). Coherence, 

according to Canale, consists of four conditions: 

(1) development — a sense of direction and order of presentation 
of ideas 

(2) continuity — consistency of facts, opinion and writer 
perspective, as well as reference to previously mentioned ideas and 
the relevance of newly introduced ones 

(3) balance — relative emphasis accorded each idea (main or 
supporting) 

(4) completeness — the degree to which the ideas are sufficient to 
provide a thorough discourse (p. 6) 

These four conditions work at both micro-levels (between sentences and 
within a paragraph) and macro-levels (across paragraphs). 

In this study we will focus on condition (1) the sequencing of ideas. 
Experimenting with this condition, however, we will also touch on conditions 
(2) and (3). Condition (4) will not be considered here since it is not 
an experimental variable but a given condition, corrmon to all the experimental 
texts. 



ERLC 



44 



CHAPTER TWO 



36 



Returning to our sample sentence (see above B. 1.a.1) Utterances , pp. 
21-22), we will put it into context: 

1. The population threat must be faced • • . for what 
it inevitably is: a central determinant of man's 
future, 

2. Last year the world's population passed 4 billion. 

3. Unless there is a holocaust brought on by man or 
nature, the world's population will continue to 
increase. 

This is an exanple of a text or a piece of connected discourse. It presents 
a problem, the threat of overpopulation, and implies a solution, man's 
awareness of this problem and his responsiblity for stopping its spread. 
The three sentences are linked by their common approach to the subject of 
population control. The type of text is argumentative expository prose. 

These sentences are part of a larger text. If the position of these 
sentences is changed so that they do not appear consecutively but intermingled 
with other sentences in the text, it is reasonable to expect that both the 
balance of ideas and the continuity of facts and writer's perspective will 
be affected. Whether this change also affects difficulty of reading 
comprehension will be one of the factors investigated in this study. 

b. Micro-level and Macro-level Analyses 

Linguists speak of two levels of coherence: local or micro-level and 
global or macro-level J Van Dijk (1931) explains the difference 
clearly: 
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We distinguish between two kinds of coherence, viz. 
local and global coherence. Local coherence is defined 
for (pairwise) relations between sentences of a textual 
sequence. Global coherence is defined in terms of 
(operations on) Whole sets of sentences, e.g. for the 
discourse as a Whole. Global coherence is also known, 
in more intuitive terms, as the 'theme 1 , f upshot f , or 
•gist 1 of a discourse or a passage of the discourse. It 
is made explicit in terms of semantic macrostructures . 
These are derived from sequences of text by so-called 
macro-rules , which delete or select information 
(propositions), generalize, or construct more embracing 
propositions, (p. 268) 



Baten (1981) explains the distinction in grammatical and lexical terms: 



An analysis of 'micro-level 1 involves an analysis 
of the word, clause, or sentence level, i.e., the 
micro-elements. A 'macro-level' analysis focuses not 
only on macro-structures, i.e., a paragraph or a text, 
but also on various features from the perspective of the 
whole discourse (e.g., lexical chains in a text), (p. 
20) 



Kintsch (1977) explains the usefulness of macro-analysis: 



It is insufficient to represent the meaning of a text 
proposition-by-proposition; these propositions must be 
organized into some overall structures, which is the 
macro-structure of the text. It is necessary to assume 
the existence of this processing stage, because without 
it we have no means of dealing with such important 
concepts as the gist of a text, or its summary, (p. 
35) 

Van Dtjk (1980) also includes summaries and paraphrases as macro- structures, 
(p. 100) 

At this point it is possible to redefine texts and coherence in terms 
of macro-structures. Using the terms micro- and macro-structure, Baten 
(1981) gives thi3 definition of coherence: 
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According to ton WJk (1977 c) t text coherence means 
that a) the denoted facts in a text are related (linear 
coherence), and b) these relations must be relative to 
a topic of discourse (global coherence). Furthermore, 
the coherence of this over-all organization of the text 
can be represented by a set of macro-propositions. 
Macro-propositions are t in short t assignments of global 
meanings and references of the text under examination, 
(p. 118) 

In our sample utterance (3ee above B.2.b. t Definitions, pp. 33- 36), 
the micro-level analysis would deal with the sentence sequence of: 



On the macro-level, the topic would be the problem ot population 



The theories on the functioning of macro-structures have direct bearing 
on the effect of changing the order or sequencing of sentences in a text 
to obtain a fairly readable text version. We are not speaking of scrambling 
a text beyond recognition, but of changing the order to obtain an alternative, 
acceptable version of the text. (See below C. 2.b. 1 )a)2), Concentration 
of Information: Chunking / Macrostructures / Superordinates, pp. 60- 



1. writer's warning (and implied solution), 



2. fact supporting writer's argument, 



3. one unacceptable solution (implying that there are 
other, better ways to solve the problem) 



control. 



62.) 



ERLC 



47 



CHAPTER TWO 



39 



3. Cohesion 



a. Definitions 



In this study, the definition of Cohesion is essentially the one given 
by Halliday and Hasan (1976): 



Cohesion refers to the range of possiblities that exist 
for linking something with what has gone before. Since 
this linking is achieved through relations in MEANING . 
. . , what is in question is the set of meaning relations 
which function in this way: the semantic resources which 
are drawn on for the purpose of creating text • . . . 
we have to show how sentences^ which are structurally 
independent of one another, may be linked together through 
particular features of their interpretation; and it is 
for this that the concept of cohesion is required • (p. 
10) 

According to Halliday and Hasan, there are two elements involved in cohesion: 
the presupposed element ("referent") and the presupposing element ("reference 
item" or "the item") (p. 4). Cohesive relations are not limited to sentence 
bouidaries (pp. 7-9)^. For example, we rr-?y change our sample utterance 3 
(see above B. 2.a., Definitions , p. 36) from: 

Ihless there is a holocaust . . . the world's population 
will continue to increase. 



Unless there is a holocaust ... it will continue to 
increase. 

The presupposed element the worlds population is referred to by the 
presupposing element it. 
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Cohesion is overtly signalled by such markers as it, so, and yet 
(Halliday and Hasan 1976). In Grimes 1 words (1978), cohesion 



has to do with the means of introducing new information 
and of keeping track of old information, rather than 
with what the content of the new or old information 
actually is. (p. 113). 

In other words, cohesion occupies itself with the signalling more than 

with the message. 

Beaugrande (1980) stresses the element of surface structure: 



COHESION subsumes the procedures whereby SURFACE 
elements appear as progressive occurrences such that 
their SEQUENTIAL CONNECTIVITY is maintained and made 
recoverable, (p. 19) 
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b. Cohesion vs. Coherence 

In the theoretical literature, the terms coherence and cohesion 

overlap. Part of what Kintsch and van Dijk (1978) and van Dijk (1980) call 
"coherence 11 (i.e. t the "reference 11 component of semantics) is in fact what 
Halliday and Hasan (1976) term "cohesion" (van Dijk 1977 c t Note 1 t p. 
126). To confuse matters even more, Crothers (1979) states that coherence 
and cohesion are identical (p. 1). Qutwinski (1976), on the other hand, 
has decided to avoid the term "coherence" altogether even th^u , he is 
discussing the same phenomenon, and uses only the term "cohesion." 

In an attempt to clarify matters, we wish to point out some areas 
where cohesion and coherence, as defined in this study, are different. 



J. Cohesion is the overt relationship between propositions 
e/pressed through sentences. Where we recognize that 
there is a relationship between the illccutionary acts 
bMch propositions, not always overtly linked, are being 
used to perform, then we are perceiving the coherence 
of the discourse. (Widdowson 1978, pp. 28-29) 

(See al o Levy 1979, p. 184; Widdowson 1979» p. 145; 
Langleben 1981, p. 280, pp. 23S-288) 

2. One can trace proposi tional development through 
cohesion and illocuttonary development through coherence. 
(Widdowson 1978, p. 30) 

3. Language can be cohesivo (i.e., contain linking words) 
without being coherent (i.e., making sense). (Widdowson 
1978, p. 45) 

Note: The converse is also true: language can be 
coherent without being cohesive (i.e., containing no 
overt markers of cohesion). 

4. Cohesion is one aspect of coherence (van Dijk 1977 
c, Note 1, p. 126; Baten 1981, pp. 66-67; Langleben 1981, 
p. 280) 
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Thus Beaugrande ( 1 980 ) says: 



cohesive devices • • . do not make the text coherent; 
the prior assumption that the text is coherent makes 
these devices useful* (p, 13*0 

This distinction between cohesion and coherence is well explained by 

Carrell (1982): 



Cohesion is not the cause of coherence; if anything, 
it f s the effect of coherence. A coherent text will 
likely be cohesive, not of necessity, but as a result 
of that coherence. Bonding an incoherent text together 
won f t make it coherent, only cohesive, (p. 486) 



recognizing that a text is about an example of a class 
of situation makes possible the complete processing of 
the cohesive elements in that text. If a reader does 
not have, or fails to access, the appropriate background 
schema underlying the text, all the cohesive ties in the 
world won't help tha text cohere for that reader, (p. 
485) 



Widdowson (1979) distinguishes between cohesion procedures, where the 
propositional development can be traced by looking at anaphora, thematization, 
and grammatical cohesion, on the one hand, and coherence, where the language 
user is aware or illocutionary connections in the expression of particular 
propositions, on the other hand. Tierney and Mosenthal (1981) have shown 
cohesion and coherence to be unrelated factors in a text. 
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c. Means of Cohesion 



According to Halliday and Hasan ( 1 976 ) t 



cohesion is expressed partly through the grammar and 
partly through the vocabulery. (p. 5) 



Halliday and Hasan refer to two types of cohesion; grammatical and lexical, 
although they admit that 



there is no hard-and-fast division between vocabulary 
and grammar. (p. 5) 



They subdivide grammatical cohesion into the categories of reference (e.g., 
anaphora), substitution, ellipsis, and conjunction, and they subdivide 
lexical cohesion into the categories of general items, superordinate 
relationships, repetition, synonymy, and collocation. 

Although other definitions and categorizations of cohesion exist 
(Quirk et al. 1972, Lyons 1977» Beaugrande 1980, van Dijk 1980), this study 
will work with the one given by Halliday and Hasan (1976), 

d. Grammatical Cohesion — Anaphora 

1 ) Reference 

a) Exophoric Reference 

Exophoric reference is situational (Halliday and Hasan 1976, p. 33). 
It takes us outside the text altogether and is therefore not cohesive 
(Halliday and Hasan 1976, p. 18). For the purposes of this study, however, 
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I have decided to include exanples of exophora together with other examples 
of grammatical cohesion. 

b) Endophoric Reference 

Endophoric reference, being based on the text itself, is cohesive. 
There are two kinds of endophoric reference: anaphora and cataphora. 
Anaphora is the form of reference or presupposition that points back to 
some previous items in the text (Halliday and Hasan 1976, p. 1*1; Grimes 
1978, p. 125). Cataphora is the form of reference which points forward 
to an item not yet stated (Halliday and Hasan 1976, p. 17; Grimes 1978, 
p. 126). 

The grammatical cohesive items discussed in this study have been 
categorized differently by different linguists. Halliday and Hasan (1976) 
discuss three types of reference: personal (e.g., he, her , it, their ), 
demonstrative (e.g., this , these , that , those), and comparative (e.g., 
identical , same , such , other , else ). (This study limits itself to an 
investigation of the effects of only the first two, personal and demonstrative 
reference because they appear frequently in texts. Comparative references 
being much rarer, it would be difficult to draw meaningful conclusions 
without sufficient data in this limited study.) 

In addition to th* above items, a text often contains groups of 
cohesive chains (Halliday and Hasan 1976, p. 15) (e.g.: Humor ... a sense 
of the comic . . . it . . . it . . . ) . Baten (1981, p. 63) calls this 
phenomenon "cohesive harmony. w This study will also examine the effect 
of cohesive chains on reading comprehension. 
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2) Substitution 

Substitution Is a device for abbreviating and avoiding repetition 
(Quirk et al. 1972). Halliday and Hasan (1976) speak of nominal substitution 
(e.g., one/ones , the same , so), verbal substitution (e.g. t do, b£, have ), 
and clausal substitution (e*g., so, not). The categorization of substitutes 
refers to the three forms of noun, verb, and clause substitution. 

Let us examine some sentences from Text 2 (See Appendix B) . 

example (1): Original Version 

An Increase in the education of women tends to lower 
fertility to a greater extent than a similar increase 
in the education of men. 

example (2): Doctored Version 

An increase in the education of women tends to lower 
fertility to a greater extent that it does in the education 
of men. 

In the second example the word jjb substitutes for the noun phrase an 
increase in the education , and the word does substitutes for the verb 
phrase tends to lower fertility . One question asked in this study is 
whether either of these two versions is easier for EFL learners to read. 

3) Ellipsis 

Like substitution, ellipsis is "an abbreviating device that reduces 
redundancy" (Quirk et al., 1972, p. 537). They describe ellipsis in the 
following way: 
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Ellipsis is a purely surface phenomenon . . . . 
Words are ellipted only if they are uniquely recoverable, 
i.e. there is no doubt as to what words are to be supplied, 
and it is possible to add the recovered words to the 
sentence, (p. 536) 



A major use of ellipsis is the avoidance of repetition, 
and in this respect it is like substitution, Can 
often be used instead of ellipsis, (p. 537) 



Halliday and Hasan (1976) explain ellipsis by contrasting it with 
sub stitution: 



An elliptical item is one which, as it were, leaves 
specific structural slots to be filled from elsewhere. 
This is exactly the same as presupposition by substitution, 
except in substitution an explicit •counter 1 is used, 
eg: one or do, as a place-marker for what is presupposed, 
whereas in ellipsis nothing is inserted into the slot. 
That is why we say that ellipsis can be regarded as 
substitution by zero. (p. 143) 



An example of ellipsis appears in Text 3: 

How much money a person needs . . . will vary .... 
Tn general, more is needed with each passing year. 

H^e, the word more is understood as meaning: more money . The word money , 
however, is omitted. This omission is called "ellipsis. tt 

Halliday and Hasan (1976) divide ellipsis, like substitution, into 
nominal, verbal, and clausal categories. However, so few examples of each 
category were found by the researcher in Mie experimental texts used in 
this study, that all these are condensed into a single category called 



ellipsis . 
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e. Lexical Cohesion — Reiteration 



"alliday and Hasan (1976) distinguish between grammatical and lexical 
cohesion in the following way: 



Reference, substitution and ellipsis are clearly 
grammatical, in that they involve closed systems: simple 
options of presence or absence, and systems such as those 
of person, number, proximity and degree of comparison. 
Lexical cohesion is, as the name implies, lexical; it 
involves a kind of choice that is open-ended, the selection 
of a lexical item that Is in some way related to one 
occurring previously, (p. 303) 



Halliday and Hasan (1976) define reiteration in the following 
manner : 



Reiteration is a form of lexical cohesion which 
involves the repetition of a lexical item at one end of 
the scale; and a number of things in between — the use 
of a synonym, near-synonym, or superordinate . . . one 
lexical item refers back to another, to which it is 
related by having a common referent, (p. 278) 

Four subcategories of reiteration are discussed: 



1. the same word 

2. a synonym or near-synonym 

3. a superordinate 

4. a general word 



These subcategories are exemplified in the following sentences: 



1. He found what he thought might be an interesting 
pamphlet on the shelves. Upon inspection, however, the 
pamphlet turned out to contain irrelevant material. 
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d. He found . . • pamphlet • . . the booklet . . ♦ ♦ 



3. He found • . . pamphlet . . . the publication • • . 



4. He found . . . pamphlet 
to be irrelevant. 



the material turned out 



lh these examples the word pamphlet is first repeated, then replaced by a 
synonym, a superordinate, and finally by a general word. 

The distinctions between categories are not always clear and obvious, 
however. The general noun is considered part of lexical cohesion. 
Nevertheless, it is not very different from the pronoun (see above B. 3.d., 
Grammatical Cohesio n, pp. 43-46 )• 

Halliday and Hasan (1976) explain the class of general noun in the 
following way: 



On the borderline between grammatical and lexical 
cohesion is the cohesive function of the class of GENERAL 
NOUN. We can speak about a borderline here because a 
general noun is itself a borderline case between a lexical 
item (member of an open set) and a grammatical item 
(member of a closed system) . . . examples: people, 
person, man, woman, child, creature, thing, object, 
stuff » business, affair, matter, move, place, question, 
idea. (p. 276) 



This listing is similar to the reiteration category called lexical cohesion 
by other linguists (Leech 1974, p. 100; Gutwinski 1976; Lyons 1977). 

f . Boundaries between Grammatical and Lexical Cohesion 

After having identified, defined, and categorized grammatical and 
lexical cohesion, I would like to add a word of caution. The distinctions 
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may be theoretically clear, but they tend to become blurred when one applies 
them to actual texts. As some linguists have explained (Cruse 1975, 
Halliday and Hasan 1976), boundaries are not always hard-and-fast, and 
therefore categorizations are not precise in the absolute sense. There 
may be some disagreement among linguists when categorizing markers of 
coherence and cohesion. 

4. Reading and the Extra-Textual World — Pragmatics 

Reading a text involves more than lexico-grammatical , linguistic 
meaning. It also entails knowledge of what has been called the social- 
cultural meaning (Fries 1954), the social system (Halliday 1978, p. 79), 
the social context or semiotic structure (Halliday 1978, pp. 110, 122), 
the physical and social situation of speaker and hearer (Winograd 1977, 
p. 75), situationality (Beaugrande 1980, p. 20), the real world (Candlin 
et al . 1978, p. 196) — in other words, what is generally known as the 
pragmatic meaning of a text. 

Pragmatics includes the pragmatic meaning and speech act / illocutionary 
force of an utterance (Widdowson 1979, p. 123; van Dijk 1980, p. 175, and 
1981, p. 221) — which together express the writer's intention (Bever and 
Townsend 1979, p. 169). 
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At this point in the study, we propose a model for the description 
of discourse (i.e., reading) with the aid of which we can explain how 
writers express their ideas and readers discern meaning in the text. 

jjsr of FeAWes }A/cmJej> i// 
MODEL OF DISCOURSE 

a. Non-Linguistic Elements: situational-semantic components — 
prepositional content 

1) reader's contextual frame(s) 

a) subject matter 

b) paragraph-level concepts: real -world 
information (Obvious/Implied) 

2) writer's intention 

b. Linguistic System: functional-semantic components — 
prepositional development 

1) Coherence (little or no overt signalling) 

a) concentration of information: micro-propositions, 
macro-propositions 

b) order of information: sequencing of propositions 
(Given/New) 

c) interpreting information: speech acts/ 
illocutionary acts/ sentence functions/ 
rhetorical functions 

2) Cohesion (overt signalling) 

a) grammatical 

b) lexical 
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This model is based on the work of Halliday and Hasan (1976), van 
Dijk ( 1 976) t and Widdowson ( 1 978) . The model proposed here is not meant 
as an integrated combination of the theories of all three linguists. Rather, 
it is a working plan in which those features believed to be especially 
relevant to the purposes of this research were selected and modified. 

Having presented a model of discourse, we now wish to explain how it 
applies to the reading process. First, we will show how the reading process 
is defined and described in the literature. Then we will explain the 
connection between the model of discourse, the reading process, and reading 
difficulty for both native readers and students of English as a Foreign 
Language (EFL). 
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C. THE READING COMPREHENSION PROCESS 



1. Reading Defined 



In general terms, there is agreement in the literature about how 
reading is defined. According to Goodman (1972), "Reading is the 
reconstruction of meaning" (p. 46). Other researchers ag^ee with this 
basic definition (Robinson 1960, Freedle and Carroll 1972, Marshall and 
dock 1978-79, Gorman 1979, Neufeld and Webb 1981). Carroll (1972) comments 
mor>* specifically on the problems involved in this definition: 



The commonly accepted definition of comprehension 
is that it is the process of apprehending the "meaning" 
of something — the "meaning" of a word, of a phrase or 
idiom, of a sentence, or of a longer discourse. This 
implies that in order to assess the comprehension of a 
given segment of a verbal message, we must identify the 
"meaning" that is to be comprehended. The identification 
of meaning is a difficult and tangled problem, (p. 10) 



Smith (1976) gives a differently phrased definition, focusing on the 
reader: 



Information is the reduction of uncertainty by the 
elimination of alternatives, (p. 16) 



This definition suggests why the extraction of meaning is so complicated. 
Thorndike (1917) likens it to solving a problem in mathematics: 



Understanding a paragraph is j.ike solving a problem 
in mathematics. It consists in selecting the right 
elements of the situation and putting them together in 
the right relations, and also with the right amount of 
weight or influence or force for each. The mind is 
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assailed as it were by every word in the paragraph. It 
must select, repress, soften, emphasize, correlate and 
organize, all under the influence of the right mental 
set or purpose or demand, (p. 329) 



In this sense reading may be defined as "a disambiguating process" 
(Schlesinger 1977) or "the way in which ambiguity is resolved in an attempt 
to derive meaning" (Neufeld and Webb 1981, p. 2). 

Focusing on the reader, Smith (1976) defines comprehension as "the 
interpretation of experience; relating new information to what is already 
known" (p. 240). This definition introduces another factor into the reading 
process: the notions of given and new are added to the decision-making 
process of the reader. 

Shifting the responsibility of the reading process further In the 
direction of the reader, Sanford and Garrod (1981) state: 



The ultimate goal in understanding a piece of discourse 
is to relate it to some hypothetical or real state of 
the world — in other words, to determine to what it is 
that discourse refers .... Finally, reading depends 
upon the attitude and competence of the reader, (pp. 
187-188) 



As Carrell (1982) explains, the relation between text and reader is 
the basis for schema theory: 



Schema theory maintains that processing a text is an 
interactive process between the text and the prior 
background knowledge or memory schemata of the listener 
or reader, (p. 482) 



62 



CHAPTER TWO 5« 

The concept of tt schema" is concisely described by Cicourel (1980): 

A schema refers to a data structure by which generic 
concepts stored in memory can be represented, (p. 
118) 

Thus the definitions of reading range from emphsasis of the text, on the 
one hand, to emphasis of the reader, on the other. In this study, both 
aspects will be examined. 

2. Factors Involved in the Reading Process 

There are basically two sets of factors involved in the reading 
process: on the one hand, it involves the ret of non-linguistic elements 
centered in the reader and the writer, and on the other hand, it involves 
the set of linguistic elements in a text. This dichotomy has been recognized 
by many researchers (Klare 1963 and 1976; Nile 1963; Schlesinger 1968, 
1977; Gilliland 1970; Freedle and Carroll 1972; Macworth 1972; Olson 1972; 
Strang 1972; Thorndyke 1976, 1979; Perfetti and Lesgold 1977; Fishman 1978; 
Widdowson 1978, 1979» and 1980; Marschark 1979; Iser 1980; van Dijk 1980; 
Neufeld and Webb 1981; and Sanford and Garrod 1981). 
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a. The Non-Llnguistlc System; Sltuatlonal-Semantic 
Components -~ Proposltlonal Content 

1 ) Reading Comprehension for EFL Learners 
vs. Native Speakers of English 

In adapting a reading comprehension model 9 we are making the following 
assumptions: 

1. that the model works in the same way for EFL learners 
as for native speakers of English 

2. that the problems of advanced EFL learners are similar 
to those of less skilled, poor, or not-so-fluent, native 
readers. 

These assumpcions are In keeping with findings in the literature. 
Baten (1981) found that the mother tongue reading model was applicable in 
the foreign language (p. 153). 

The problems reported by researchers working with foreign language 
learners (Kaplan 1966, Gorman 1979» Hatch 1979, Sim 1979t Baten 1981, and 
fteufeld and Webb 1981) were similar to those reported by researchers working 
with native speakers (Niles 1963, Wright 1972, Meyer 1875, Meyer et al . 
1980, Perfetti and Lesgold 1977, Levelt 1978, Marshall and Glock 1978- 79t 
Irwin and Davis 1980). 
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2) The Reader 1 s Contextual Frame(s) 

a) Subject Hatter 

learning to read is not a matter of a child relying upon 
instruction, because the essential skills of reading - 

- namely the efficient uses of nonvisual information - 

- cannot be taught. (Smith 1976 t p. 179) 

What Snith (1976) refers to js "nonvisual information" includes subject 
matter and knowledge of the real world. Many researchers believe that 
knowing the subject matter aids reading comprehension (Strang 1972, Klare 
1976, Kintsch and Vipond 1977, Kieras 1978, Marshall and Glock 1978-79, 
Levy 1979, Baten 1981, and Neufeld and Webb 1981). Grellet (1981) says, 
"what one brings to the text is often more important than what one finds 
in it" (p. 7). 

b) Real-World Concepts (Obvious/Implied) 

Not only knowledge of the subject matter in the text, but also a more 
general pragmatic knowledge of the world is involved in reading (Weaver 
1964, Schlesinger 1966, Carroll 1972, Clymer 1972, Strang 1972, Halliday 
and Hasan 1976, Thorndyke 1976, Winograd 1977, Gorman 1979, Hatch 1979t 
Widdowson 1980, Tierney and Mosenthal 1980, Baten 1981, Neufeld and Webb 
1981). 

According to Beaugrande (1980), one could only understand a concept 
found in t text if one had encountered it previously in the real world: 
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It seems to me that referring is in fact accomplished 
via the entire TEXT-WORLD MODEL . . • • If people do 
match the content of texts with their notion of the real 
world, then the completed text-world model should give 
the clearest indication of what to look for. (p. 66) 



Smith (1978) refers to this prior knowledge as redundancy , arguing 
that the reader could not perceive the redundancy in a written text unless 
it reflected Knowledge already present in the reader's mind (p. 19) • 

This knowledge of the world extends to the reader 1 s expectations 
concerning what is found in a given text. The reader is required to make 
inferences about information in the text, whether this information is 
explicitly stated or implied in the context (Schlesinger 1966, Olson 1972, 
Thorndyke 1976, van Dijk 1980). The more explicit the text, the easier 
it is to read (Schlesinger 1966, p. 189; Baten 1981, p. 119). 

3) Writer's Intention 

The reader's task includes not only the deciphering of information, 
but also understanding the writer's intentions. There must be communication 
between the writer and the reader. For the purposes of this study, the 
writer's intention includes more than the construction of a coherent and 
cohesive text. It alco includes the reader's recognition of the writer's 
meaning, purpose, cone, and mood/attitude (Clymer '.972, Davis 1972, Spearritt 
1972, Strang 1972). 

The difficulty for the reader is that the writer's intention does not 
necessarily appear as explicit information in the text. According to 
Marshall and Clock (1978-79): 
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The truly fluent reader is one who can infer the 
complete text base of a discourse from incomplete 
information in the surface structure. This reader 
comminicates with the author through the discourse very 
efficiently. 

The not-so-fluent reader is one who cannot infer 
the existence of structures in the text base unless these 
structures are explicitly referenced in the surface 
structure of the discourse. This reader does not 
comminict.te efficiently with the author. He comprehends 
what the author says rather than what the author means, 
(pp. 51-52) 



For students of EFL, this difficulty is compounded. On the one hand, 
their language proficiency may not be adequate, so that they may not notice 
clues such as cohesive markers (Sim 1979) and sentence structure (Pierce 
1 973t Baten 1981). On the other hand, they m?v not be sensitive enough 
to semantic, stylistic, and cultural nuances (Baten 1981). For both these 
reasons students of EFL find it more difficult to follow the writer's 
intention. 
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b. The Linguistic System; Functional-Semantic 
Components — Prepositional Development 

When reading a text, readers contribute their prior knowledge, 
experience, and expectations. What they find in the text itself Is the 
development of the writer's ideas, or propositional content. There are 
various explanations in the literature as to how these ideas in the text 
are processed. 

1 ) Coherence (little or no overt signalling) 

a) Concentration of Informa tion: 

Micro-propositions, Hacr ^propositions 

1 ) Number of Propositions and Reading 
Time and Difficulty 

According to Kintsch et al. (1975), 

reading time increases monotonlcally with the number of 
propositions in a text base, even if the length of the 
corresponding text is controlled, (p. 206) 

They also believe it to be common sense that a text which repeats the same 
ideas is easier than a text which discusses many different ones (p. 
197). 

Moreover, according to Kintsch and Vipond (1977), the number of 
propositions also affects reading difficulty: 

texts may be comparable in word length, but they may 
differ in the number of propositions expressed by these 
words, (p. 3**3) 
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Fishman (1978) and Baten (1981) have found that it is not the length of 
the toxt (i.e., the number of words), but the number of propositions that 
affects the reading process. 



2) Concentration of Information: Chunking 
/ Macrostructures / Superordinates 

According to Smith (1978), chunking is "the organization of information 

into the most compact (most meaningful) unit" (p. 208). The chunking model 

is generally accepted in the literature (Miller 1956, Weaver 1965, Chafe 

1972, Kintsch 1977, Marschark 1979, Sim 1979, Baten 1981). 

Other researchers call the same phenomenon by different names. Van 

Dijk (1977 b) speaks in terms of the reader's use of macrostructures: 



If a discourse is at all long, subjects are unable to 
process it at a micro-level alone: not only are they 
unable to store and retrieve such discourse verbatim, 
but they are also unable to retrieve the constituent 
propositions. At the same time, if the sequences of 
sentences can be assigned a macro-structure, they will 
be recalled mu h better than scrambled sequences. Thus, 
comprehension . . . probably takes place at several 
levels, such that lower-level information is organized, 
reduced, and represented at higher levels. These processes 
involve the use of macro-rules; the input to the macro-rules 
is the micro-structure, and the output is the macro- 
structure, (p. 4) 



Elsewhere, van Dijk (1980, pp. 14-15) gives three functions which 
macrostructures serve during reading comprehension: to organize complex 
(micro-)information so that units may be distinguished and can be used to 
form larger units, to reduce complex information so that less important 
micro-information may be disregarded, and to construct (or represent) new 
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meaning on a global level from information derived from many local meanings 
so that additional ways of comprehension of complex information are created • 
According to Kintsch and van Dijk (1978), both fluent and not-so-fluent 
readers comprehend at the micro- and macro-levels. 

It must be borne in mind, however, that the concepts of micro- structure 
and macro-structure need a context of more than one or two short paragraphs. 
For short, 150-word texts, Kintsch and Vipond (1977) do not distinguish 
between micro-structure and macro-structure. Since we wish to research 
students 1 reading on both micro- and macro-levels, the texts used in this 
study are fairly long and contain several paragraphs. 

Using the terms superordinates and subordinates instead of macro- and 
micro-structures, Crothers (1972), Kintsch et al. (1975), Meyer (1975), 
Kintsch and Vipond (1977), and Vipond (1980) all found the same results: 
superordinates are recalled more often than subordinates. Superordinates 
are defined as more general, abstract levels of the text, whereas subordinates 
are details and examples. 

Kieras (1978) suggests a reason for this discrepancy between recall 
of the general and of the specific. In this view, the reader has sufficient 
expectations about global, high-level text organization so that he understands 
the text. On the lower level of paragraphs and sentences, however, the 
reader does not have prior knowledge. 

In all these cases where content stereotypicality 
is lacking, the reader must rely on essentially syntactic 
information, or textual surface structure (van Dijk 
1972), to specify how the text content should be - in teg rated, 
(p. 1*0 
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For this reason, the micro-propositions may be less easily recalled, and 
may also be more difficult to comprehend. 

Kieras (1978) extends this theory to apply to writing style: 



The bad paragraph orders have many new sentences and 
thus entail maintaining several separate chunks for a 
time. In contrast, the good orders establish a single 
chunk at the outset and just add each subsequent proposition 
to this single chunk, (p. 25) 



By a chunk , Kieras is referring to a chunk of information which is comprised 
of an integrated set of propositions. Kieras found that top-down (main 
idea topmost) passages produce higher recall than bottom-up (least important 
ideas first) passages. That is, the paragraph will be easier to read if 
the first sentence is an important one. (p. 19) 

For foreign language learners, the problem of decoding on the sentence 
level is compounded by their difficulty with the language itself as well 
as with the ideas in the text. Tn fact, this language problem may prevent 
them from using the information in tht text to derive macro-structures 
(Widdowson 1980, p. 242). 



One of the questions asked in this study is whether the sequence or 
order in which propositions appear in a text affects reading comprehension; 
that is, whether changing the coherence of a text will change its 
under standability. There seem to be two arguments, one in favor of and 
the other against the idea that changes in sentence sequencing affect 
reading comprehension. 



b) Order of Information: Sequencing 
of Propositions (Given/New) 
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On one hand, many linguists assume that a change in context will 
result in a change of meaning of a word or sentence* Widdowson (1978) 
argues that different versions of text function differently: 



to alter the arrangement is to alter the illocutionary 
character of the discourse. Although they can all be 
said to be 1 saying the same thing 1 , they are not all 
doing the same thing* Are they, then, all equally 
coherent? That is to say. is the illocutionary development 
equally acceptable in each case? (p. 



He answers the question in the negative (p. 45), explaining that deviations 
or differences from the normal patterns of coherence strain the reader, 
and that therefore the more usual the text version, the more acceptable 
it is. 

Van Wjk (1980) also argues that a change in context will affect text 
readability: 



Since each speech act, by definition, changes the 
(pragmatic) context, it is also able to influence the 
initial successfulness conditions of further (speech) 
acts. If we have informed somebody about something by 
asserting that £, the context may have changed such that 
the hearer after the assertion knows that £; this new 
context would make new assertions of £ by the same speaker 
in the same situation theoretically inappropriate, (p. 
181) 



Niles (1963), Bever (197i>), Danes (1974), Meyer (1975), Halliday and 
Hasan ( 1976), Gutwinski (197" Fishman (1978), Kieras (1978), Marshall 
and dock (1978-79), Gorman (»; Meyer et al. (1980), and Tanenhaus and 
Seidenberg (1981) would all agree that surface order can influence 
comprehension of concepts in a text. Widdowson-3 statement (1978) is 
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appropriate here: "The re-arrangement of propositional content, then, has 
illocutionary implications." (p. 41) 

On the other hand, other researchers (Clymer 1972, Davis 1972, Strang 
1972, and Thorndyke 1976, 1979) have shown that readers or hearers naturally 
try to impose some meaningful interpretation on a series of given propositions. 
Qutwinski (1976) explains: 



The order in which sentences follow one another in a 
text is an important feature in the recognition of a 
grotp of sentences as a text- This can be testified to 
by the fact that speakers of a language, when presented 
with any assembly of sentences following one another - 
- even when those sentences have been chosen from various 
distant parts of a text and put together randomly, will 
try hard as they can to impose some interpretation on 
the whole. Simply by virtue of their appearing in a 
certain order together, the assumption is made that the 
collection of sentences is a text. (p. 54) 

Thus, according to this viewpoint, it does not matter in what order the 

li-tU or /h'fc'-mft-/)'^ >n ft**- 

^ sentences appear; readers will try to fabricate a text from them according 
to some already existing pattern in their mind, 

Strang (1972) explains that the reader, "reading beyond the 
lines," 



may arrange the author 1 s ideas into new patterns, extending 
their scope or fusng them with ideas that he himself has 
gained from reading or from experience, (p. 75) 



Experiments with memory have shown that readers do not recall specific 
words or sentences and retain only the meaning or "gist" of the text (Weaver 
1962, Sachs 1974, Hirsch 1977, Marshall and Glock 1978-79, Forster 1979, 



ERLC 



73 



CHAPTER TWO 65 



Marschark 1979? Sanford and Garrod 1981). Also working with memory, Kintsch 
(1977) assumes that each reader has stored in his mind a fixed story schema 
which he fills in, in the order that the information is given, while 
reading: 



Scrambling the order of paragraphs in a well- structured 
story affects comprehension remarkably little . . . The 
reason for this, I suggest, is that comprehending such 
a story involves filling in waiting slots in a fixed 
story schema according to certain well known rules and 
strategies. Even if the paragraph order is scrambled the 
reader can, with a little extra effort, find the correct 
place for each paragraph in that schema, (p. 50) 

Thorndyke (1979)» researching newspaper stories, draws the same conclusions. 

Although the studies by Kintsch (1977) and Thorndyke (1979) pertain to 

narrative texts whereas this study deals with exposi ory, argumentative 

texts, we believe that the same principles hold true for both types of 

texts, at least to some extent. 

These two arguments are presented in an article by Kintsch and van 

Wjk (1978), who do not see them as conflicting. First, they argue that 

the reader provides the missing links in a discourse even if the propositions 

are not directly connected (p. 365). Then they explain that each sentence 

must be interpreted according to the context of the surrounding sentences 

(p» 390). It is possible, then, that sentence order affect reading 

A 

comprehension v*ien readers do not provide their own links but use only the 
links found explicitly in the text. This kind of reading would probably 
be found with the not-so-fluent reader 3 (Marshall and Clock 1978-79). 
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Sentence comprehension is rlso seen by Auble and Franks (1983) as an 
interaction between two processes. Proposing tb'j "computation model" of 
comprehension, they discuss the interaction between top-down processing 
from activated schema and bottom-up processing from concepts in the 
sentence: 

Sentence processing is seen as a combination of bottom-up 
processing from the sentential information with top- 
down processing from activated schemata. ... Comprehension 
occurs when preexisting knowledge structures have been 
modified and combined in such a way that optimal fit 
with the novel information expressed in the sentence is 
achieved, (p. 396) 

Thus top-down and bottom-up processing seem to occur simultaneously (see 
also Adams 1980 and Rumelhart 1980). Presumably, the top-down component 
would not be affected by sequencing of information, but the bottom-up 
component would be affected. 

Another argument against the notion that changes in sentence order 
affect readability pertains to the transformation from micro-structures 
to macro-structures. Van Dijk (1980) gives a list of transformations and 
then explains: 

These transformations in principle allow that the resulting 
reproduction of a text is different from the information 
in the text. (p. 262) 

If there is indeed no one-to-one correspondence between the meanings 
in a text and the surface structure by which the are realized (see above 
B.l.b.2), Meanings and Their Surface Manifestations , pp. 26), then these 
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transformations are made by readers automatically as they read. That is, 
readers simultaneously read a text and concentrate the many micro- 
propositions into a relatively small number of macro-propositions 
simultaneously while reading. If it is true that readers reorganize the 

ideas in the text diring the reading process, no mstter how the propositions 
(or +tu S*«U<+i<± an\44,l>)*$ ) 
are presented, then it may not really matter in which order they receive 

A 

the information to begin with. Oh the other hand, the nunber of reorganizations 
necessary to process the information may also directly contribute to reading 
difficulty (Baten 1981, p. 17) 

Beaugrande (1980) offerr another solution: 

Miscues due to COHERENCE occur when spreading 
activation of already processed concepts provides material 
interpolated at other points , . . . suggest that surface 
sequencing has an important influence on text processing, 
even though quantitative recall was not severly affected, 
'p. 227) 

That is, the difficulty may not appear quantitatively; nevertheless it 
exists. Baten (1981) found that changed order might make the text more 
difficult to process without affecting performance on comprehension 
questions. The problem of the effect of changed sentence order on reading 
comprehension will be researched further in this study. 

Still another possible explanation was offered by Marshall and Clock 
(1978-79). Testing two groups of truly fluent and not-so-fluent readers 
at two American colleges, Marshall and Clock found that the not-so- fluent 
group relied upon the surface structure to provide all cues as to meaning, 
whereas the truly fluent group were capable of ignoring surface structures 
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and could infer the complete message even when it was not explicitly stated 
in the text, (p. *»7) The implication of this study would be that changes 
in order of information would affect students of lower English proficiency 
rather than students of higher English proficiency. 

Another sequencing factor affecting reading comprehension is whether 
a text contains information familiar to the reader ("Given") or presents 
new information ("New"). Readers try to relate, each sentence to ideas 

A 

they already know .'Strang 1972, Thorndyke 1976, Kierar 1978, Beaugrande 
1980, Vipond 1980, Sanford and Garrod 1981). If the information is not 
readily familiar (i.e., not part of the short term memory), a search is 
made in the long term memory. This process adds to the reading processing 
time (Kintsch and Vipond 1977). 

Although the Given/New dichotomy may be a factor in comprehension, 
it is difficult to determine for any reader which specific information is 
Given and which is New (Sever and Townsend 1979). For this reason, this 
dichotomy will not be directly researched in this study except as a possible 
factor affecting the ease or difficulty of comprehension resulting from 
changes in sequencing. 

o) Interpreting Information: Speech Acts/ 
Illocutlonary Acts/ Sentence Functions 

Focusng on the relations between sentences, we deal with speech acts 
(illocutlonary acts) and sentence functions. Researchers who have pointed 
out the role of sentence (rhetorical) function in reading comprehension 
are Niles ( 1 969 ) t Clymer (1972), Allen and Wlddowson (1974), Carpenter and 
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Just (1977), Fishman (1978), Gorman 0979), and Beaugrande (1980). Van 
Dijk (1980) goes as far as to claim: 

We may predict part of the meaning/reference of a sentence 
just by knowledge of the assumed or expected speech act 
performed and of the actual social context, (p. 206) 

Familiarity with rhetorical functions is especially important for the 
EFL learner. Kaplan (1966) demonstrates paragraph developments different 
from those normally appearing in English. As a result, he advocates the 
teaching of contrast! ve rhetoric in the same sense that contra stive grammar 
is presently taut/ t (p. 14). 

Following this line of reasoning, we decided to examine sentence 
(rhetorical) functions as indicators of reading difficulty. Finding a 
useful categorization of sentences and paragraphs by which to analyze 
texts, however, was not an easy task; a variety of categorizations exists 
In the literature. 

Speech act theory, as formulated by Austin (1962), presents a list 
of illocutionary acts, of which we found the expositives (e.g., illustrate, 
clarify, refer, argue, insist, define) most pertinent to our study. These 
speech acts may be direct (i.e., explicitly stated) or indirect. More 
recently, Cicourel ( 1980) lists six categories of performative verbs: 
statements (e.g., quote, claim), directives, questions, reactions (e.g., 
agreeing, disagreeing), expres3ives (e.g., approving, disapproving), and 
commissives (e.g., promise, vow) (p. 105). He also includes "contrasts'* 
among speech acts (p. 108). Since acts of exposition are only one aspect 
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of speech act theory, and since this study deals only with exposito. y 
prose, we found Cicourel f s categorization inadequate for our analysis of 
discourse • 

Other categorizations, based on speech act theory, were more specific 
to our needs. Wilkins 1 (1976) communicative functions have a category 
called "rational enquiry and exposition" which includes definition, cause, 
reason, result, classification comparison, contrast, generalization." 
Notions of contrastive relations (e.g., equality, correspondence, contrast) 
and logical relations (e.g., conjunction, inclusion, cause, effect) are 
listed by van Ek (1975). Discourse connections in bsech and Svartvik 
(1975) include: Initiate, digress, add, reinforce, summarize, generalize, 
exemplify. Based on these classifications, a list of communicative 
micro-functions was developed by Munby (1978). Communicative acts, also 
termed "rhetorical functions" by (Allen and Widdowson 197H), overlap with 
the illocutionary acts discussed by Austin (1962) and Searle (1969). The 
problem with these categorizations was that they contained much extraneous 
material that we did not need to use for the classifications of our own 
texts. 

Other linguists have categorized discourse patterns in terms of 
conjunctions or connectives. Halliday and Hasan (1976) speak of conjunctive 
relations: additive, adversative, temporal, and causal. Beaugrande (1980a) 
sees thu relationships as subtypes of j unction : conjunction (additive), 
disjunc i (alternative), conjunction (oppositional), and subordination 
(hierarchical or contingent) (p. 289). Included arnong van Dijk's (1972) 
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connectives are: conjunction, disjunction, contrast, causality, and 
reason. 

Viewing these relations in terms of logical connectors rather than 
as illocutionary acts emphasizes their semantic rather than their functional 
aspect. Theoretically sound as these categorizations may be, however, 
they are not thorough enough for our specific needs of examining expository 
written prose. 

The categorization used in this study is based on lists of sentence 
types (Jones and Faulkner 1968, Larson 1967). Explicitly written to analyze 
prose style, they are based on the empirical examination of many expository 
prose paragraphs. It is interesting to note that this empirically based 
list includes categories from both illocutionary acts and conjunctive 
relations. The list of sentence types that will be used in this study 
includes the following: alternative, amplification, answer, cause, 
comparison, contrast, definition, evaluation, evidence, example, generalization, 
inference, parallel idea, question, related action, restatement, result, 
and summary. 

In this study the term "sentence function" refers to the sentence 
level, whereas the term "illocutionary force" is used to refer to the 
paragraph level. The nonspecific general term that will be used to include 
both the semantic and functional components of speech acts, illocutionary 
acts, and sentence (rhetorical) functions will be "discourse patterns." 
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2) Cohesion (overt signalling) 

Following the distinction made by Halllday and Hasan (1976), this 
study will examine separately the difficulties caused by Rrammatical and 
lexical cohesion. This is not an easy task since the distinction is not 
always clear-cut. Furthermore, it should be noted that as cohesion is one 
aspect of coherence (see sbove B.3»b., Cohesion vs. Coherence, pp. *J1- 



'12 ), so grammar is only one among several semantic devices (Olson 1972, 
pp. 148-^9) in the reading processes. Goodman (1969) describes how the 
reader uses these devices: 



syntactic information: 



This is the information implicit in the grammatical 
structures of the language. The language user knows 
these, and therefore, is able to use this information 
before he learns to read his native language, (p. 17) 



semantic information: 



As he strives to recreate the message, the reader utllzes 
his experiential conceptual background to create a meaning 
context. If the reader lacks relevant knowledge, he 
cannot supply this semantic component and he cannot read 
.... All readers regardless of their general reading 
proficiency are incapable of reading some material in 
their native language, (pp. 17-18) 

For EFL readers, whose vocabulary, if not their grammatical knowledge 
is limited, this problem is especially acute. 

A study by Sirn and Bensoussan (1979) suggested that for EFL students, 
function words (e.g., conjunctions, prepositions, pronouns) appear as 
difficult to master as content words (e.g., nouns, verbs, adverbs). 
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In contrast, among the list of devices to facilitate the integration 
of ideas from different sentences. Carpenter and Just (1977) list anaphoric 
reference, intersentential connectives (e.g., therefore, because, however), 
and repetition of keywords (pp. 233-23*0. Likewise, Fishman (1978) views 
anaphora as aiding comprehens .on and taking less reading time because the 
information refers to recently activated structures in the memory. For 
EFL learners, however, these items may actually be obstacles to fluent 
reading. 

This paradox is summed up by Tanenha: and Seidenberg (1981): 

many of the stylistic devices that complicate sentence 
processing such as pronominalization, ellipsis, and 
subordination seem to facilitate discourse processing, 
(p. 212) 

As there is disagreement in the literature concerning the effects of 
cohesive items on reading difficulty, and as the effects of different 
cohesive items may Interact interdependently (Dillon 1978, Baten 1981), 
we will examine some of these cohesive items in more detail. 

a) Grammatical — Anaphoric Reference 

The finding of antecedents is listed by Davis (1972) as one of the 
important comprehension skills among mature native readers. Consequently, 
inability to understand anaphoric referents in a text would impede 
comprehension . 

It was suggested by Levenston (1976) that grammatical anaphora would 
be problematic for native Hebrew speakers because Hebrew prefers .not 
anaphora but lexical repetition: 
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A Hebrew speaker, for example, who fails to follow the 
drift of an extended passage of English prose may be 
more baffled by the "excess" — to him — of anaphora 
than by any specific lexical difficulties, (p. 22) 



Researching the effects of the presence or absence of items of 
grammatical cohesion in texts, Sim (1979) found that anaphora affected the 
reading comprehension facility of EFL university students. Examining scores 
of students of low English proficiency, Sim found that items of anaphora 
were difficult for these students to process. He also found that markers 
of grammatical cohesion affected difficulty more than did content words 
(items of lexical cohesion). For students of higher English proficiency, 
however, grammatical cohesion did not have so great an effect. In fact, 
sections of text containing anaphoric items were actually easier for these 
students than sections without the items. 

Berman believes that EFL students may have difficulty with: 



relating pronouns to their relevant antecedents. This 
can lead to ambiguity of interpretation where none is 
intenued, or to outright misinterpretation of parts of 
a text. (p. 2^8) 



Frederiksen (1981) found that native English speaking high school 
students required more time v*ien reading sentences which contained reference. 
The best predictors of text difficulty for college students were found by 
Dutka ( 1978) to be the length of the anaphoric referent (i.e., longer 
referents predicting greater difficulty) and the distance between the 
anaphoric item and its referent (i.e., the greater the distance, the more 
the difficulty in reading comprehension). Length accounted for 25% of the 
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variance in test scores; distance accounted for 23% of the variance; length 
and distance together accounted for 36* of the variability. Researching 
advanced EFL students at Haifa University, Sim (1979) found similar results. 
He found that greater distance between the anaphoric item ani its referent 
caused more difficulty. Greater complexity and length of the referent also 
appeared to cause reading difficulty. Furthermore, Sim (1979) found that 
cataphoric items presented greater difficulty than did anaphoric items. 
Repetition or redundancy of anaphoric items, however, was found to make 
reading easier. 

iim (1979) states: 



each factor alone (i.e., antecedent size and distance 
from the anaphoric item) does not seem to cause difficulty 
in reading comprehension . . • . But in combination, the 
two factors do appear to cause difficulty, (p. 189) 



Nevertheless, other researchers (Hasan 1977, Baten 1981) did not find 
that anaphora affected reading difficulty. 

Working with younger EFL students on a lower level of proficiency, 
Baten (1981) fomd that neither reference words (anaphora) nor conjunctions 
(logical connectors) affected reading difficulty (p. 70). 

Fishman (1 978) also found no significant effect of anaphora. She 
hypothesized that paragraphs containing anaphora would produce a more 
complete semantic representation of a paragraph in the memory of a reader 
than would paragraphs without such cohesive ties. Assuming that items of 
anaphoric reference present old information, she argues: 
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Their presence in a text ought to help the reader organize 
material as it is read. Because references do not present 
new information such as that found in lexical items, the 
time required to read sentences and paragraphs containing 
references should be shorter than the time needed to 
read paragraphs containing lexical items rather than 
references, (p. 160) 

Whether anaphoric reference is an aid to comprehension or an obstacle 
to certain readers under certain conditions is still an open question. 
This study will research the problem further. 

b) Lexical 

1 ) Content Words / Vocabulary 

It is an obvious fact that the difficulty of the vocabulary in a text 
affects reading comprehension. What is not so obvious is how the effect 
of vocabulary difficulty compares with other variables in the reading 
process. In this study, changes in coherence (i.e., different order of 
sentences) are compared with changes in lexical cohesion (repetition, 
synonyms, superordinates, general words, lexical chains) and grammatical 
cohesion (changes in number and kind of reference words). 

A pilot study of the latter two — differences between lexical and 
grammatical cohesion, has already been carried out by Sim (1979). The 
results were contradictory. In ;wo different sets of texts, Sirn found the 
following hierarchy of difficulty: 

Thus logical connector items represented most difficulty; 
anaphora items came next in order of difficulty; and 
content words third, (p. 166) 
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Logical connectors were found to be the greatest obstacle to reading 
comprehension. Sim was surprised at the unexpected absence of difficulty 
where the content words had deliberately been made harder (p. 141). 

In a third set of textc, however, the vocabulary factor was indeed 
mere difficult. It was followed by logical connectors, with anaphora being 
least difficult. This last set of findings is what would be expected 
according to the literature (Klare 1976, Marshall and dock 1978-79, Baten 
1981, Neufeld and Webb 1981). 

To add to the complexity of the problem of determining difficulty of 
vocabulary is the factor of context. Some words are difficult because 
they are unfamiliar. Other words are treacherously familiar but, used in 
unfamiliar conte<3, they shift in meaning and may thus block comprehension 
of the text (Niles 1979, Nilagupta 1976 ) - Students' preconceived notions 
about familiar v*>rds prevent them from correctly guessing different meanings 
of polysomes in unfamiliar contexts (Laufer and Bensoussan 1982, Bensoussan 
and Laufer 1984). 



In any text, there are many redundant cues which are vital to 
comprehension (Schlesinger 1977, Smith 1978). It is assumed that the 
reader picks up the cues and makes use of the redundancy during the process 
of reading comprehension while storing the information in the memory (Weaver 



2) Redu id a ncy; repetition (reiteration) , 
synonyms, lexicaT~chains 



1962). 
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In the course of the text, a writer may use the same idea more than 
pnce. Heferring to this idea of reiteration, Halliday and Hasan (1976) 
explain that the writer may either repeat the same word, use a synonym, 
or insert a pronow. It is possible for writers to substitute any of these 
kinds of words because they can assume that readers have prior knowledge 
not only about the ideas but also about the words which represent them. 
It is generally assumed that when words are repeated, the reader's task 
is easier than when synonyms or pronouns are used (Flesch 1950). When the 
same word is repeated, or when the same idea is repeated by means of 
synonyms, the repetitions form a lexical chain: 



It may mean that the words used in one text, which form 
lexical chains, can be perceived by the reader as 
'belonging' together and therefore do not require from 
the reader that they be processed as completely new 
lexical items. Thus, if more words of one text belong 
to the same lexical chain(s), then less processing demand3 
occur. This implies that less long term memory searches 
are necessary, and/or less load is laid on the short 
term memory activity. (Baten 1981, p. 68) 

The effect of redundancy on reading comprehension will be further res-arched 
during the course of this study* 
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D. MEASURING TEXT READABILITY 

1. Disadvantages of Readability Formulas (see above A. 2., pp.19- 

*\) 

a. Surface Factors of Prose and Meaning 

Many researchers argue that the readability formulas, dealing only 
with the surface structure or stylistic aspects of a text, neglect its 
meaning or content (Meyer 1975, Brown 1976, Hirsch 1977, Beaugrande 1980, fl* r < 1 
Baten 1981). Moreover, since the formulas are not based on any theory of 
language, there is no way to develop hypotheses for improving them (Bormuth 
1967, Irwin and Davis 1980). Nor do they reflect text organization. 
Consequently, formulas cannot discriminate between scrambled and well- 
ordered sequences (Kintsch and Vipond 1977). Researchers (Bormuth 1976, 
Kintsch and Vipond 1977) have pointed out that readability formulas only 
show correlations, but they do not explain the causes of reading 
difficulty. Nor do different formulas correlate highly among themselves (Klare 1982 and 1984. 

Most formulas are based on word length and sentence complexity. Yet 
Rothkopf (1972) claims: 

sentence complexity and lexical factors such as frequency 
of use have small effects on what is learned fronr text 
by adults providing that inspection time is not limited, 
(p. 320) 
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1 ) Sentence Length and Complexity 

According to Dale and Chall (19W, longer sentences usually make 
comprehension more difficult. These findings were recently borne out for 
advanced EFL students by Sim (1 979). 

Schlesinger (1966), however, disagrees, arguing that sentence length 
has little effect on readability (pp. 92-93). He admits that longer 
sentences are often more complex: 

it may be that a tendency exists among writers to use 
longer — and possibly also more complex sentences 
when treating of more difficult subject matter, (p. 
86) 

He also states that short sentences are more redundant, and therefore 
easier than long sentences (p. 87). It was found, however, by Bensoussan 
( 1980) that it is often the long sentences that are redundant and the 
shorter ones that contain anaphoric references that may concentrate a 
phrase, a sentence, or a whole passage into a single pronoun or pro- verb. 
Other researchers (Bormuth 1966, Herriot 1970, and Baten 1981) have also 
explained tha 1 ; the longer sentences are not necessarily the more complex 
ones, and that these two factors (sentence length and sentence complexity) 
are separate and independent measures of readability. 
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2) Word Length and Familiarity / Frequency 

Gllllland (1970) found word length not very useful as an Isolated 
measure of readability (p. 414). Rothkopf (1972) explains that average 
word length reflects the structure of the sentence as well as the 
characteristics of the Individual word because It is influenced by the 
number of function words and personal pronouns in the text. For this 
reason word length is not a simple Indicator of meanlngfUlness and familiarity 
(p 317) Baten (1981) also explains that word length only influences 
reading ease directly if the longer word is morphologically more complex 
(p. 51 )• 

Dale and Chall (1948) and van Parr»ren and Schouteu-van Parreren 
(1981) have argued that unfamiliar words are another factor making 
comprehension more difficult. For this reason word "Msts of familiar words 
have been compiled. The objection here is that the concept of word 
familiarity Is subjective, since a general frequency count cannot show how 
familiar a wo -d is for any given individual (Gtlliland 1970, Baten 
1981). 

This lack of one-to-one correspondence is even more crucial for EFL 
students, whose vocabulary is dependent on their educational background 
and not necessarily similar to that of other nonnative speakers, or to 
that of the native speakers for whom (and from whom) the word counts were 
originally produced. 
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b. Readability Formulas and the Reader 

Readability formulas pay no attention to the psychological processes 
in reading comprehension. They merely predict language difficulty (Bormuth 
1976, p. JJ87)* Other researchers agree that the formula fails to deal 
with the process of reading (Irwin and Davis 1980, Baten 1981^ kV* lfn 1 
The formulas take into account only the average group of readers 
(Baten 1981, p. 150). Some researchers (Dale and Chall 1 9M 8, Rothkopf 
1972, i&are 1976) explain that the formula takes into account neither the 
readers' knowledge of a particular subject nor their intellectual and 
maturity levels. For these reasons Laroche (1979) says that the formula 
is unsuitable for foreign language material. It does not take into account 
the student's linguistic problems with the language but rather 

presupposes an intuition of the syntactic, lexical and 
stylistic resources of the target language, (p. 13 1 *) 

c. Accuracy 

According to Bormuth (1976), readability formulas are not very accurate, 
having validity correlations of nly about .5 to .7 (p. Other 
researchers (Gilliland 1970, Baten 1981) have also found them inaccurate. 
Stokes (1978) found that they are not very reliable. 
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Klare (1963) gives one reason why prediction of readability is low 
for reading levels: 



These levels are in terms of materials of average 
difficulty for average students of a given grade, and 
are usually based on the results of standardized tests. 
In some cases, the criterion of understanding of a passage 
is correct answers to 75$ of the comprehension questions, 
in other cases to 50%. This in itself is responsible 
for some formula error, at least insofar as differences 
among formula ratings are concerned. As indicated 
earlier, agreement on a standard level is needed • (p. 
175) 



Moreover, the higher the educational level, the less accurate the 
reading formulas appear to be (Klare 1963 1 976 ) • Readability formulas 
are apparently most accurate on the level of elementary education (Hirsch 
1977). 

Considering the weaknesses of ;he readability formula, researchers 
agree that it should be used in conjunction with other measures of readability 
(Klare 1963, Meyer 1975, Hirsch 1977). For this reason, the difficulty 
of texts examined in this study will be measured in a variety of ways in 
addition to using readability formulas. 
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2. Cloze Tests as a Measure of Readability 



According to Corrigan and Upshur (19P~/t test method is one factor 
that influences test results. In order to avoid the undue influence of 
any one test^ therefore, different testing methods will be used to measure 
^ext comprehensibly for advanced EFL students. In addition to the Flesch 
Reading E? *e Formula and discourse analysis, the cloze procedure will also 
be used. 



a. Definition of 'Cloze 1 



The term ? cloze 1 first appeared in an article by Taylor (1953) as a 
better measure of readability than readability formulas. Taylor recommended 
random deletion to sample the ability of a student to comprehend a text. 
Oiler and Conrad (1972) explain the reasoning behind the 'cloze 1 
procedure: 



The term 'cloie' was rsed with the notion of Gestalt 
"closure 11 in mind, referring to the natural human 
psychological tendency to fill in gaps in patterns. The 
restoration of words deleted from a selection of prose 
in order for :h2 passage to make sense is a special use 
of this ability to complete broken patterns, (p. 183) 



Carroll (1972) explains Taylor's procedure: 



The procedure Involves taking a passage of text and 
deleting words in it by some rule, e.g., every 5th word, 
every other noun, or every other "function* word. A 
subject is than presented with the passage and asked to 
guess the missing words, (p. 18) 
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Although linguistic criteria (parts of speech or function words) may 
enter into the cloze procedire, is is the randomness, and not the structure 
of the text, that counts. From this automatic, mechanical deletion process 
sprang a whole literature which applied this procedure to a large variety 
of texts and students, making claims for its performance, criticizing its 
effectiveness, and suggesting modifications in scoring methods and deletion 
rates. Since this study will use the modified rational cloze as one of 
the methods to verify the difficulty level of texts, we will give a general 
outline of the literature on the cloze to date, and explain the basis on 
which it will be used here. 

b. Reasons for Advocating the Cloze 

A nunber of researchers (Taylor 1953 and 1956, Gilliland 1970, Hirsch 
1977) see the cloze procedure as an accurate measure of readability for 
two reasons: it includes the reader, and it makes use of semantic and 
syntactic redundancy Ln the text (i.e., the context) in the calculation 
of the readability score. That is, it corrects some of the faults of the 
readability formulas. 

Redundancy, as defined by Klare (1963) refers to "the extent to vMch 
a given unit of language is determined by nearby units" (p. 172). Like 
readability, perception of redundancy varies not only with the materials, 
but also with the readers (Klare 1963» pp. 173—1 7 1 * ) . 

Some researchers claimed that the cloze is a global measure of language 
proficiency for native speakers of English (Weaver 1962 and 1965, Bormuth 
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1967 and 1968, Ramanauskas 1972, Oiler 1975, and Ozete 1977). This claim 
was joon extended to include normative speakers of English as well (Oiler 
and Conrad 1972, Oiler 1 973t Irvine et al. 1974, Stubbs and Tucker 1974, 
Jonz 1976, Chihara et al. 1977, Berkoff 1979). 

c. Problems with the Random Cloze Procedure 

Not all researchers are enthusiastic about the cloze as a global 
measure of reading proficiency, however. Kintsch and Vipond (1977) do not 
believe redundancy and readability to be closely related: 

The cloze procedure, on the other hand, is probably 
actually misleading. It measures the statistical redundancy 
of a text, which is a far cry from its comprehensiblity. 
By that score, a high-order statistical approximation 
to English that nevertheless constitutes incomprehensible 
gibberish would be preferred to a well-organized text 
with less predictable local patterns, (p. 337) 

Other researchers are also skeptical of the random cloze procedure (Carroll 
1972; Porter 1975; Alderson 1969, 1979» and 1980; Baten 1981; and Klein- 
Braley 1981). 

Opponents of the random cloze present a list of drawbacks • They state 
that it does not measure what its promoters say Lt does. Language production 
being necessary, it is not only a measure of reading ability (Porter 1975). 
Changes in deletion rates can alter the test unpredictably, so that it 
cannot be universally applied to every text (Alderson 1969, 1979, and 1930; 
Klein-Braley 1981). It is not a test of global comprehension across 
sentence boundaries but a discrete item test that is sentence (or even 
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clause) bound (Alderson 1959, Carroll 1972 t Klein-Braley 1981). Randon 
cloze tests do not always distinguish between natives and ronnatives 
(Alderson 1980) since even natives also have difficulty filling in the 
cloze and are not necessarily able to get a perfect score (as would normally 
be expected on a test for foreign language learners). 

d. Modified Rational Cloze 

Having rejected the random clo-r.e as hot being an automatically valid! 
testing procedure, a number of resear^ners suggested rational deletion 
methods according to linguistic principles (Weaver 1962 t Greene 1965 t 
Alderson 1969, franney 1972-73, Klein-Braley 1981). Greene (1965) explains 
the rationale behind a modified cloze test which he constructed: 

each possible deletion was evaluated by the author for 
possible effectiveness and deletions made on this rational 
rather than mechanical basis. For each word deleted 
under the modified cloze procedure, there was felt to 
be sufficient redundancy remaining in the passage so 
that a sup€ or reader could make positive identification 
of the mis ng word. (pp. 213-21*0 

Other researchers advocate deleting certain parts of speech (Weaver 1962, 
Klein-Braley 1981) or a certain percentage of content vs. function words 
(Berkoff 1979). 

Working with nonnatives, Bachman ( 1 982) deleted on the basis of 
syntactic (clause-level context), cohesive (inter-clausc- or inter- sentential 
context), or strategic (parallel) patterns of coherence (p. 63). Also 
working with EFLstudent3, Berkoff (1979) and 3itn (1979) experimented with 
rational cloze to test comprehension of items of coherence and cohesion. 
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In this study, the rational cloze is used, with deletions determined 
according to the criteria set by G-eene (1965) based on sufficient redundancy 
to make sense to the competent native reader. 

3. Multiple-Choice (M-C) Tests as a Measure of Readability 

a. The Function of M-C Tests 

Comprehension is most commonly measured indirectly by asking questions 
about the text (Meyer 1975, p. 7). There is an assumed relation between 
students 1 comprehension of a passage or text and their ability to answer 
questions on that passage or text (Davies 1968, Carroll 1972, Kintsch and 
Vipond 1977, Sim 1979). That is, comprehension test scores are expected 
to reflect level of reading comprehension* In technical terms, this means 
that test writers make a model of the text. They also ask questions that 
reflect comprehension of the text and decide on model correct answers. 
IXring marking, the test-writer's model is compared with students 1 answers 
(Frederiksen 1972): the smaller the difference (i.e., the closer the 
students 7 performance to the model answers), the higher the scores and the 
more reading comprehension is assumed to have occurred. 

Multiple-Choice (M-C) tests are one type of reading comprehension 
test where the possible answers are already given to the student. The 
examinee is required to select the correct answer from a number of alternative 
responses (Cohen 1980). It is a test purely of reading and thinking; no 
writing is required. 
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Short-answer or open-end comprehension questions involve writing and 
are more difficult to mark. Furthermore, Sim (1979) found that for advanced 
EFL university students, no significant difference appeared between scores 
on questions in M-C and open-end formats. Sim (1979) showed that question 
format affected neither the difficulty nor the effectiveness (i.e., the 
Discrimination Index) of test questions. 

b. Constraints of M-C Questions 

1 ) Relation Between Comprehension of Text 
and Correct Responses to Questions 

Many researchers have criticized the M-C test format because they 
question tfiether correct responses on questions accurately reflect reading 
comprehension (Gilliland 1972, Uiinman 1973). Sim (1979) found a Pearson 
correlation of only .29 between the Flesch Reading Ease Formula for 
difficulty of texts and the percentage of correct student answers to 
questions. Nevertheless, Henning (1975) found M-C questions to be a valid 
measure of foreign language reading comprehension. Bormuth (1969) found 
that M-C scores correlated highly with cloze scores. 

>) The Test Writer 1 s Ability to Define 
Question Function 

Meyer (1977) complains of a lack of theory on which to base the writing 
of questions on texts. Other researchers (Fishman 1978, Sim 1979, Baten 
1981), however, have based much of their research on M-C questions. Sim 
(1979, p. 9*0 lists a taxonomy of ten question types for the function of 
comprehension questions: 
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1. main idea of passage 

2. main idea of paragraph 

3. comprehension of sentence or sentence pair 

4. use of examples or comparison 

5. implication or inference 

6. word meaning 

7. referential system 

8. logical relations 

9. language of caution and approximation 

10. ability to paraphrase 

Questions which can be classified accordirg to this taxonomy will also be 
used in this study. 

3) Sensitivity of Questions to Specific 
Points in the Text 

Without directly asking the meaning or reference of a particular word 
or phrase, it is difficult to write comprehension questions so specific 
that they can pinpoint difficulty in particular sections of text (Klare 
1976, Sim 1 979). The danger here, according to Sim ( 1 979) f is that by 
drawing attention to the specific point, the test writer may actually cause 
a specific test difficulty where no text (i.e., reading) difficulty existed 
before it was directly questioned (see also Corrigan and Upshur 1982). 

In order to avoid the creation of artificial obstacles by test 
interference in the reading process, we decided in this study to ask mostly 
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general comprehension questions. The kind of question we have not asked 
is: 

"this" (line — ) refers to: 1) study 2) test 3) 
obstacle 4) comprehension 

On the other hand, we have asked content questions on sections of text 
containing reference items. 

c. Problems with the Text 

1 ) Motivation and Choice of Subject Matter 

Even outside the test situation, different texts affect different 
readers in various ways* It is assumed that the more prior knowledge about 
a subject readers bring to a text, the more readily they can read that 
text (see above C.2.a.2), The Reader f s Contextual Frame(s) , pp. 56-57). 
According to Klare (1976), 

where knowlege of content is very high before reading, 
the effect of improved readability may be washed out,... 

It may sound obvious to say that subjects can have 
too high a level of background and knowledge for the 
effects of readability to be clearly shown, (p. 144) 

In auiition, the emphasis on grading in the test situation also appears 
to distort the significance of motivation by subject matter only. According 
to Klare (1976), the reader motivation factor can cross test results. 
Working with texts varying in difficulty, he found significant differences 
in comprehension scores only when the students were not highly motivated. 
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That is t when students were highly motivated, they were more likely to 
correctly answer questions even on difficult texts: 

Where a priority is desired, it pays more to improve 
the readability of low-preference rather than higher- 
preference material; the effects on reader behavior are 
likely to be more notable, (p. 142) 

Klare suggests that in the interpretation o* test scores, the researcher 
should take into account the reader f s intellectual level, maturity, 
background information, and motivation. For foreign language learners, a 
final addition to this list would be language proficiency. 

2) The Technique of 'Doctoring' Texts 

Working with authentic texts, the researcher has a problem, for they 
do not always contain many instances of the linguistic feature which is 
being examined. According to the literature (see above B. I.b . 3) Alternativ e 
Versions of Text, p. 27, and 4) Text vs . Context , pp. 28-29), different 
versions of a text may be written. Furthermore, if there is to be an 
f experimental f text, including the linguistic items to be examined, and a 
'control 1 text which does not include them, the researcher is required to 
re-write or 'doctor 1 the text so that it is acceptable in both the original 
and the doctored versions. 

In the doctoring process, this study isolated certain features which 
were expected to affect reading comprehension difficulty. One version, 
the 'doctored, 1 contained as many items of a given feature as it was 
possible to include without rendering the text stylistically unacceptable, 
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whereas the 'original' version, as far as possible, did not contain these 
itrms. 

The doctoring technique has already been used by other researchers. 
Fishman (1978) used the doctoring technique to research reference and noun 
phrases. Sim ( 1979) used it to examine reference, conjunctions, and 
sentence length. Both researchers also used M-C comprehension questions 
with each text to evaluate reading comprehension. The results, however, 
were not always conclusive because of the impossiblity of completely 
separating overlapping effects of other syntactic an.] semantic influences 
in the text (Weaver 1965). To this reason for inconclusive results we 
might add reader motivation (see above D.3.C.1), Motivation and Choice of 
Subject Hatter , pp. 91-92). 
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4. A Variety of Measures 



Because of the complexity of the reading process, no one measuring 
device or language comprehension test can be relied on to show any particular 
linguistic feature as a cause of reading difficulty. According to Carroll 
(1972), 



There is no one technique that universally gives valid 
and reliable information. It is 3eldom the case that 
success or failure in any of these tests can unequivocally 
be traced to success or failure in language comprehension 
since there are other factors of guessing, inference, 
memory, reliance on prior knowledge, etc., that are 
operating. The influences of these other factors must 
be controlled as characteristics, control of temporal 
factors, and instructions to the subject* (p. 24) 



In the light of this warning by Carroll, this study used a variety cf 
techniques (Cloze, M-C, Flesch Reading Ease Formula, Discourse Analysis) 
on the assumption that taken in conjunction, these devices will yield a 
general picture of what causes reading difficulty for foreign language 
learners. 
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E. SUMMARY 

This chapter presents an overview of the literature on discourse 
analysis, the process of reading comprehension, and testing techniques. 
It provides the basis for the analysis of texts and the interpretation of 
experimental results. We have given the theoretical basis for our application 
of reading comprehension theory to the texts examined in this study. 

Most linguists see cohesion and coherence as separate entities in 
discourse theory. Tn the processes of doctoring texts, writing test 
questions, and analyzing texts, we have usd the classification of cohesion 
presented by Halliday and Hasan (1976) and the aspect of coherence that 
pertains to the order in which information is presented (see Canale 1982). 
We have categorized sentence types along the lines of speech act theory. 

To apply the theory to the problems of reading comprehension, we turn 
to the theories of reading processes. T\*o major trends appear in the 
literature: the schema (macro-proposition) theory, whereby sentence order 
wuld not matter since the reader provides the missing links in a discourse, 
and the micro-proposition theory, whereby sentence order does matter since 
each new bit of information modifies the given information before it. 
Recent research indicates that there is no real contradiction here and 
that both processes may occur simultaneously. 

The question remains as to which type of paragraph or text structure 
is mce easily or efficiently read: the top-down text where the main ideas 
appear first or the bottom-up text where secondary ideas or examples appear 
first and the main idea comes at the end as a sort of conclusion. 
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Various methods of testing reading comprehension will be used to 
answer these questions: discourse analysis, the technique of doctoring 
texts, a readability formula, M-C tests, and rational cloze. This chapter 
describes the advantages and disadvantages of each method so that results 
. can be interpreted accordingly. Given these tools, we will attempt to 
determine the effect of certain textual conditions on our SFL students 1 
ability to read expository texts. 
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1 . feat vac Cijk calls contest, EaUiday and Hasan call text. 

2. Beading each sentence in seance, the reader receives the information in a 
particular order and for*, an idea of what the text is about. If the orter of tte 
sentences in a eiven text were chafed so that it still made sense, the information 
•-ould s-.il! be the sane. fc t the context in „ Uo h this information appeared would 

Perceive the ideas in a different order, the reader would have a different 
Picture of the focus of the reordered text. Thus one would suspect that the ori^ 

text and its alternative doctored version (i e ,- n a na , \ 

version u.e., m a new context) could not be 

considered equivalent. 

3. Van Dijk (1977, n. 7, note 4) observer -f-W +v,o + - 

i-« ooserves that the notion of macro-structure was 

first used by Bierwisch ( 1 965 ) for sueeifin ( a „ \ 

p; tor specific (e.g., narrative) structures of discourse. 

Since then it has been discussed by van Diik (iqv? 107^ r- x , 

j van uiji. vi y^, 1975;, Kmtsch and van Dijk (1975), 

and van Dijk and Kintsch (l 9 77), among others. 

3eixvisch, Manfred ( 1 9 6 5 ) "Poetik «* Lin^stik," i„ Helmut Kreuzer and Rul 

Ver^u^u^^^ 
^^e^ (Munich: Kumpheburger) . Kintsch and van Dijk ( 1975 ) "Cogent 
on se rappelle et on resume des histoires," Languages, .40, 98-116. 
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CHAPTER THREE 
METHODS 

A. OVERVIEW AND BASIC ASSUMPTIONS 

One purpose of this study is to determine whether advanced EFL 
students' difficulty in reading English texts is affected by certain 
features of cohesion and coherence. Since reading difficulty is not always 
measured in the same way, more than one method was used in this study to 
evaluate the reading problems of first-year students at Haifa University. 
These methods included a readability formula, a nunber of reading comprehension 
tests (including multiple-choice (M-C) comprehension questions and modified 
rational cloze procedure), and discourse analysis. 

The researcher assumed that it was possible to write texts containing 
sufficient features of cohesion (e.g., pronouns, ellipsis, repetition) so 
that the cumulative effects of cohesion and coherence in a text could be 
measured, A section of each text version was processed through the Flesch 
Reading Ease Readability Formula (Klare 1963) to quantify and measure the 
stylistic differences caused by the doctoring procedure. 

It was also assumed that students 1 interpretation of features of 
cohesion would affect their reading comprehension of the whole text, and 
that the students' ease or difficulty in reading would be reflected in 
their ability to answer comprehension questions on the text. That is, wrong 
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answers to questions were taken as reflecting some misunderstanding of the 
text. Underlying this assumption was the belief that the tests were 
reliable and that the M-C questions were fair and unambiguous in themselves 
• and would not present an additional obstacle to reading comprehension. 1 
Another assumption of this study was that some features of coherence 
and cohesion wuld cause more reading difficulty than others, and that the 
readability formula applied to the text, along with the test results, would 
provide evidence to indicate the problematic types of items. It was hoped 
that differences among text versions, as indicated by both readability 
formulas and test results, would be statistically significant, either on 
the macro- (whole-text) level or the micro- (word and sentence) level, or 
both. 2 

Since the test scores could only be meaningful in relation to the 
texts from which they resulted, techniques of discourse analysis were used 
to describe the logical sequence within each text version. Changes in 
rhetorical patterns and bemantic relations in the text versions were then 
compared with the test results. 

All tests were constructed by the researcher as mid-year and final 
examinations in the Department of Foreign Languages for the required 
advanced EFL readi g comprehension course. Teachers in the department 
made comments and corrections on the tests. 3 In this sense, the experimental 
function of the tests was secondary to their administrative function. Thus, 
student motivation was high because approximately 20% of the final mark 
depended on these test results. 
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A total of 27 tests were administered (24 versions of the six texts 
plus three of the original ("undoctored") text versions). The same 20 M-C 
questions accompanied all the versions of a text. When the sentences in 
a text were reordered, the position of the questions was also changed 
according to the text. 

Two separate sets of tests were used: Tests 1-4 were the end of 
mid-year (first-semester) examinations in January 1978 t 1979, and 1980. 
They were administered after the first half of the EFL reading comprehension 
course (50 hoirs of instruction) . Tests 5 and 6 were administered in June 
1980, 1981 , and 1 982 as final examinations afer the second half of the 
course (100 hours of instruction). 11 Each test took the duration of a class 
period (two hours) to complete. 

It was assumed that differences in student scores of M-C and of cloze 
tests would be related to the different text versions created by the 
"doctoring" procedure. In addition to total test scores, however, other 
measures of text difficulty were also used. Specific M-C questions relating 
directly to doctored sections of text were examined separately. Tf 
differences in reading difficulty did not appear on the whole-test level, 
they might nevertheless be revealed by student responses on the- single- 
quest ion level. 

Every attempt was made to achieve iniform test conditions. Examinations 
were administered during the last week of the semester, with the teachers 
acting as test proctors. To avoid cheating over the three-day test period, 
however, we administered a series of parallel tests. Teachers decided 
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which of the text versions they wished to administer to their classes. In 
many classes, teachers chose more than one text version. In this way, 
tests were not administered to the students at random but rather by teachers' 
choice. Because of this method of test distribution, however, the researcher 
had no control over the number of text versions administered.^ For this 
reason, the numbers of students taking each text version was not equal. 

For all tests, students were p<vmitted to use dictionaries (both 
monolingual and bilingual) sinae it was shown in a study by Bensoussan, 
Sim, and Weiss (1981) that the use of dictionaries does not significantly 
affect M-C test scores. Test questions were written bearing in mind the 
use of dictionaries. It was decided to permit the test situation to reflect 
the normal reading situation where students would normally refer to 
dictionaries. 
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B. RESEARCH DESIGN AND DATA COLLECTION 

1 . Subjects 

• 

In this study, the term "advanced reading comprehension* refers to 
the reading proficiency of first-year undergraduates studying in the 
Humanities and Social Sciences Departments at Haifa University. These 
students, who studied seven or eight years of English in high school, were 
attending the required English reading comprehension course during the 
time of the research. 

Tests were administered to approximately 3t6O0 students. The native 
language of most of the students was Hebrew or Arabic. While the students 
taking the tests during this research study changed each year, the size 
of the yearly population (approximately 600) remained constant. It w^s 
assumed that, on the average, the English proficiency of the students was 
on the same level each year.^ This research study was carried out over a 
period of five years (1978-1982). Since the tests were an integral part 
of the course, motivation was expected to be high. 

2. Procedures to Determine Text Difficulty 

a. Flesch Reading Ease Readability Formula 

As stated above, Chapter TWo, p. 20, the readability formula that was 
used in this research was the Flesch Reading Ease Readability Formula 
(Klare 1963) 7 : 
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Reading Ease = 206.835 - .8^6 wl - 1.015 si 

where wl = the number of syllables per 100 words 

si = the average number of words per sentence 

1 

This formula was applied to the first 100 words of each of the text 
versions. 

Although easy to apply, readability formulas have the following 
disadvantages: 

1. fb attention is paid to the psychological process of 
reading comprehension. Correlations are shown but not 
causes of reading difficulty. 

2. Research data on the formula is based on native 
readers, not EFL learners. 

3. Formulas are not very accurate or reliable. 

4. Formulas deal only with the surface structure of the 
text and neglect its content, meaning, and 
organization. 

For these reasons, in this research the findings of the readability formula 
were used in conjunction with other measures of text difficulty (see 
Appendix C, Table 1, "Texts Ranked According to Flesch Reading Ease 
Formula tt ) . 
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Tests 



Six different texts were tested in the study. Expository texts of 
general interest were chosen because that was the kind of text that was 
taught and tested during the EFL reading comprehension course. Topics 
ware selected to be as culturally neutral as possible so that no students 
would be penalized for unfamiliarity with the subject matter of the text, 
and no students should have unfair advantage because of specialized knowledge 
or culture bias. The difficulty of the texts was assumed to be based on 
language rather than on ideas. 

Each text was rewritten ( "doctored") in four different versions. Two 
of the versions appeared in the original order but contained mostly either 
items of grammatical or of lexical cohesion (as defined by Halliday and 
Hasan 1976). In the other two versions, the sentences were reordered so 
that they still made sense, but the information was presented in a different 
order. These two versions also contained mostly either items of lexical 
or of grammatical cohesion. 

The four text versions were as follows: 

1. 0L - Original Lexical Version 



2. 0G 



Original Grammatical Version 



3. RL 



Reordered Lexical Version 



4. RG 



Reordered Grammatical Version 
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For the main part of the research, each text version was accompanied 
by 20 M-C questions. As there was a large number of students to tests, 
it was decided to Uy>- the M-C format because it was easy to score and the 
results could be readily analysed by computer.** For another part of the 
research, to compare original and reordered versions of text, rational 
cloza procedure was used. For a sample of an original text, four versions 
with M-C questions, and two cloze versions, see Text 2 in Appendix B. 

1) Test Formats 

a) Multiple-Choice (M-C) Reading Comprehension 
Questions 

One purpose of the M-C questions was to examine reading comprehension 
in sections of text which contained items of lexical and grammatical 
cohesion. Unfortunately, it was not always possible to write in enough 
cohesive items without distorting the style of the text. Moreover, it was 
not always possible to ask enough good questions on the doctored sections 
of text. For technical reasons, then, there were certain doctored sections 

of text on which no specific content questions were asked. 

< 

Furthermore, in order to complete the desired number of 20 questions, 
other types of questions had to be included. Word level questions (e.g., 
"For" (line . . .) means . . . ) and whole-text level questions (e.g., "A 
possible title for this text would be . . . ") were included for 'J-.io 
reason. 
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The total test score resulted from responses to 20 M-C questions, 

only a certain number of which directly related to doctored sections of 

text. For this reason, those questions specifically relating to items of 
• cohesion in the text were examined separately. 



b) Rational Cloze Procedure 

As an alternative testing procedure, the rational cloze method was 
used to compare original and reordered versions of undoctored Texts 1- 
3.^ The cloze technique was chosen because it includes less material 
extraneous to the text. Unlike M-C format, the cloze omits questions and 
required the student to fill the blanks occurring in the text itself. 

Words were deleted by the researcher according to the redundancy of 
the context. Blanks were selected where there was enough surrounding 
context to enable a reader to guess the missing word(s). The same blanks 
appeared, except for the first and last sentences of each text version, 
in both original and reordered text versions. The number of blanks for 
Texts 1, 2, and 3 was 46, 38, and 50, respectively. 

The modified cloze tests were administered during the years 1981 and 
1982 when the departmental M-C tests were not given. Thus we could be 
certain that students had not been exposed to the original intact versions 
of text. 
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2) Doctored Text Versions 

a) Cohesion; Lexical (L) vs. Grammatical 
(G) Versions 

For each of the six texts, there were two versions containing Items 
testing text cohesion: one version Including mostly Items of lexical 
cohesion, and one version containing mostly items of grammatical cohesion, 
(It was not possible to totally exclude items of lexical cohesion, for 
example, from the grammatical version of a text without distorting Its 
style and making It sound unnatural,) For a breakdown of the number of 
items of cohesion in each text version, see Appendix C, Tables 2 and 3* 
"Items of Grammatical and Lexical Cohesion in Original and Reordered Texts," 
See also Chapter Five, B. 1.a., "Constraints on Test Development," pp. 
173-175. 

Items of cohesion were inserted according to a modified version of 
the classification by Halliday and Hasan (1976): 
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grammatical cohesion 

1) repetition of pronoun reference (e.g., ijt, his ) 

2) reference - personal pronoun (e.g. t tt, his ) 

3) demonstratives (e.g., this , that , those ) 

*0 nominal substitution (e.g., one, some , few ) 

5) verbal substitution (e.g., do, have ) 

6) clausal substitution (e.g., so, not ) 

7) ellipsis 

8) exophoric (extra-textual) reference 
lexical cohesion 

9) repetition of noun reference 
(e.g., The booklet ... the booklet ) 

10) synonym, near-synonym 

(e.g., The booklet ... the pamphlet ) 

11) superordinate, subordinate 

(e.g., The booklet ... the publication ) 

12) general word 

(e.g., The booklet ... the materia]) 
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This study separated lexical and selected features of grammatical 
cohesion to determine whether either one, by itself, or both together, 
could be shown to affect reading comprehension. Each of the first four 
texts, then, appeared in three versions: original, doctored lexical version, 
and doctored grammatical version. The three versions of text varied in 
length: 490 to 512 words for Text 1, 413 to 446 words for Text 2, 612 to 
660 words for Text 3, and 753 to 773 words for Text 4. No original version 
was tested for Texts 5 and 6; there were 529 to 613 words for the two 
versions of Text 5, and 570 to 637 words for Text 6. The difference in 
number of words ranged from 20 words (Text >{) to 84 words (Text 5). This 
difference was a result of the changes in phrasing, or of the repetition 
or omission of words caused by using mainly lexical or mainly grammatical 
cohesion in the "doctoring" procedure. 

It appeared that the shortest, most concentrated versions were usually 
those of grammatical cohesion (except for Text 4, where the lexical version 
was five words shorter). This phenomenon raises the question of whether 
there is a connection between the concentration of text and the difficulty 
of reading comprehension. 

Below is a sample paragraph from Text 3 In the original and two 
versions doctored for cohesion. 

Original version: 

To distinguish between perception of the comic in 
oneself and in others, Gordon Allport has labeled the 
former a "sense of humor" and the latter a "sense of the 
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comic." A sense of humor, therefore, is the ability to 
see oneself objectively and to be amused by one f s 
inferiorities, jealousies, and unsocial desires. It is, 
In short, the ability to laugh at oneself, A sense of 
the comic, according to Allport, is a "cruder" source 
of mirth in which enjoyment is derived fVom the inferiorities 
of others — inferiorities which make the observer feel 
superior. 



Grammatical version: 



To distinguish between a person's perception of the 
comic in himself and in others, Gordon Allport has labeled 
the former a "sense of humor" and the latter a "sense 
of the comic." The former, therefore, is the ability 
to see himself objectively and to be amused by his own 
inferiorities, jealousies and unsocial desires. It is, 
in short, the ability of a person to laugh at himself. 
The latter, according to Allport, is a "cruder" enjoyment 
v*iich is derived from the inferiorities of others which 
make him feel superior. 



Lexical version: 



To distinguish between perception of the comic in 
oneself and in others, Gordon Allport has labeled the 
perception of the comic in oneself a "sense of humor" 
and the perception of the comic in others a "sense of 
the comic." A sense of humor, therefore, is the ability 
to see oneself objectively and to be amused by one's 
inferiorities, jealousies, and unsocial desires. A sense 
of hunor is, in short, the ability to laugh at oneself. 
A sense of the comic, according t3 Allport, is a "cruder" 
source of mirth in which enjoyment is derived from the 
inferiorities of others ~ inferiorities which make the 
observer feel superior. 
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Changes in cohesion have been made according to the following principles. 
In the doctored grammatical version, the pronouns "former" and "latter" 
have been used for "sense of hunor" and "sense of the comic." The "observer" 
is referred to as a "person" and <j11 pronouns refer to him (rather than 
one or oneself ). In the lexical version, all the nouns and noun phrases 
have been repeated. 

Below is another example, also taken from Text 3: 



Original version 



Some laughter has a malicious quality: Laughing in 
triumph over an opponent, laughing at one Y s own 
"superiority," or laughing at another's discomfort is 
quite different — in both meaning and tone — from 
laughing with another person. 



Lexical version 



Some laughter has a malicious quality: jeering in triumph 
over an opponent, joking at one's own "superiority," or 
jesting at another person's discomfort is quite different 
— in both mesning and tone — from laughing with another 
person. 



Grammatical version 




Sometimes it has a malicious quality: Laughing in triumph 
over an opponent, at one's "si-periority," or at another's 
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discomfort is quite different — in both meaning and 
tone — from doing it with another. 



t In the lexical version, synonyms of laughter are used: jeering , 

joking , and jesting * In the grammatical version, the pronoun jLJt was used 
instead of the noun laughter. Mostly, the noun was omitted (ellipsis) or 
referred to obliquely as doing it (verbal substitution and repetition of 
pronoun). The pronoun a nother was also used instead of the noun phrase 
another person . 

In order to ascertain that the two doctored versions of each of the 
six different texts would be equivalent in acceptability of meaning and 
style, they were presented for criticism to four teachers in the Department 
of Foreign Languages at Haifa University and changes were made according 
to their comments. ^0 

b) Coherence: Original (0) vs. Reordered 
(R) Versions 

It was assumed that the sequencing of information affects the ease with which it :ar. 
be processed. The same information, presented differently, might focus differently or 
shift the argument (see Chapter 2, B # 1.b.3) and 4), pp. 27-28)* It was assumed that 
reordering the sentences would result in a rearrangement of the sequence in which 
information appeared in the text. Each text appeared both in the original order ar.i the 
reordered sequencing (see Appendix C, Table 4, "Key to Rearranged Sentences: Reordered 
Coherence;" Tables 4a and 4b, "Parallel Questions, Texts 1-6"). If the differences in 
sequencing affected total test scores, that would reflect their effect on comprehension. 
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For a sample test that was reordered, see Appendix B, Test 2. All 
five versions of Test 2 are included: Original (00), Grammatical (OG), 
Lexical (OL), Reordered Grammatical (RG), Reordered Lexical (RL). The two 
sets of questions (original and reordered) have also been included. Appendix 
B also includes the modified cloze test version of Test 2 (see Appendix 
C, Table 4, "Key to Rearranged Sentences: Reordered Coherence). 

o) Cohesion and Changes in Sentence Sequence 
(Coherence) 

In the reordering process, the words were not changed. Sentences 
appeared in the text in a different order. Except for Text 5, where three 
of the sentences had to be reordered from within (clauses placed in a 
different order) to maintain the natural flow of the discourse, the sentences 
themselves remained intact. However, as a result of changing the order 
of the sentences, cohesive ties were altered. A reference item of grammatical 
cohesion, for example, may hav* had a different referent because the 
previous sentence had been changed. Here is an example from Text 2: 

Original Grammatical Version (OG), paragraph 5 

A few are considering direct legal limitations on family 
size and sanctions to enforce them* No governments 
really want to resort to this, (lines 46-'J9) 
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Reordered Grammatical Version (RG), paragraph 2 



A number of governments are moving in the direction of 
coerciont No governments really want to resort to this, 
(lines 11-13) 



Each of the paragraphs appears at a different point in the text. Some 
of the sentences that appear in the last paragraph of the original version 
appear in the second paragraph the reordered version. In the original 
version, they appear in the conclusion as alternative but unsatisfactory 
solutions. In the reordered version, they initiate a discussion of a 
possible solution. The position of M-C questions pertaining to this section 
of text, moreover, Is also changed. It is no. 16 in the original test 
version and no. 6 in the reordered version (see Appendix B) . 
Another example is taken from Text 6: 



(1) In studying the history of the relationship between 
East and West, wo corae to realize that there have been 
alternating phases of Oriental and Western ascendancy. 

(2) ... And this creates the vacuum into which another 
and more virile civil ation is drawn. 

(3) For East and West, their periods of high civilization 
have never been simultaneous. Instead, they have 
alternated, the decadence of one coinciding with the 
highest achievements of the other. In its decay, each 
civilization creates a cultural vacuum into which the 
forces of the rival — and rising — one must tend to 
flow. These alternate phases assume a military form - 



Grammatical Version (OG), selections from paragraphs 1, 
2, 3 
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- the congest of one nation by another. We are at first 
inclined to see these conquests as the overspilling of 
energy, the exuberance of an achievement which can no 
longer be kept within its original frontier. Such events 
do undoubtedly occur; but further study may incline us 
to think that the vacuum is the more powerful force. 



Lexical Version (PL), selections from paragraphs 1,2, 



(1) In studying the history of the relationships between 
East and West, we come to realize that there have been 
alternating phases of Oriental and Western ascendancy. 

(2) ... And this decay creates the vacuum into which 
another and more virile civilization is drawn. 

(3) For East and West, the times of thriving culture 
have never been simultaneous. Instead, there have been 
successive epochs of dominance, the decadence of the 
East coinciding with the principal achievements of the 
West. In decline, each people creates a cultural void 
into which the forces of the rival ~ and rising — 
civilization must tend to flow. The consecutive phases 
of expansion assume a military form — the conquest of 
one nation by another nation. We are at first inclined 
to see these conquests as the overspilling of energy, 
the exuberance of an achievement which can no longer be 
kept within the original frontier. The swellings of 
power do undoubtedly occur; but further study may induce 
us to think that the vacuum is a more powerful force 
than the force of conquest* 



Reordered Grammatical Version (RG), paragraphs U-5 

In its decay, each civilization creates a cultural 
vacuum into which the forces of the rival — and rising 
— civilization must tend to flow. And this creates the 
vacuum into which another and more virile civilization 
is drawn. These alternate phases assume a military form 
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— the conquest of one nation by another. We are at 
first inclined to see these conquests as the overspilling 
of energy, the exuberance of an achievement which can 
no longer be kept within its original frontier. Such 
events do undoubtedly occur; but further study may incline 
us to think that the vacuum is the more powerful 
force. 

In studying the history of relationships between 
East and West, we come to realize that there have been 
alternating phases of Oriental and Western ascendancy. 
For East and West, these periods have never been 
simultaneous. Instead, they have alternated, the decadence 
of one coinciding with the highest achievements of the 
other. 



Reordered Lexical Version (RL), paragraph U-5 



In decline, each civilization creates a cultural 
vacuum into which the forces of the rival — and rising 
~ civilization must tend to flow. And this decay creates 
the void into which another and more virile society is 
drawn. These alternate phases of expansion assume a 
military form — the conquest of one nation by another 
nation. We are at first inclined to see these conquests 
as the overspilling of energy, the exuberance of an 
achievement which can no longer be kept within the 
original frontier. The swellings of power do undoubtedly 
occur; but further study may induce us to think that the 
vacuum is a more powerful force than the force of 
conquest. 



In studying the history of relationships between 
East and West, we come to realize that there have been 
alternating phases of Oriental and Western ascendancy. 
For East and West, the times of thriving culture have 
never been simultaneous. Instead, there have been 
successive epochs of dominance, the decadence of the 
East coinciding with the principal achievements of the 
West. 
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In each of the grammatical versions t depending on the sequencing of 
the sentences, the demonstrative this refers to a different set of concepts. 
In the original version, this refers to the dying of energy, the sterility 
of the arts, and the timidity of policy. In the reordered version, this 
refers to "a cultural vacuum into which the forces of a rival civilization 
must flow. 11 Other features of cohesion are pronouns, ellipsis, and verb 
substitution (e.g., "does"). 

This change in relations also holds true in the lexical versions. In 
addition, the demonstrative this is accompanied by the word "decay." 
Synonyms used for "decay" are "decline" and "decadence." Other synonyms 
used are "void" and "vacuity" for "vacuum," "society" and "nation" for 
"civilization," "successive" for "alternating," "times of thriving culture" 
and "epochs of dominance" for "ascendancy." The phrase "the conquest of 
one nation by another nation" later appears as the general words "these 
vast movements of mankind." 

In the original version, these sentences, interspersed with others, 
form an introduction describing the situation, questioning the cause of 
the final result, and answering or explaining the process. In the reordered 
version, however, these general comments also serve as examples (see 
Appendix C, Table 10, "Discourse Analysis — Test 6). 

The different location of the sentences and the shift in emphasis 
resulted in different sentence functions and illocutionary acts. It was 
assuned that these changes would affect the ease or difficulty of information 
processing and that these differences would be reflected in different mean 
test scores for the two test versions. 
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d) Coherence and Items of Cohesion 

The use of cohesive items can also affect the reader's interpretation 
of the organization and relations of concepts in the text* Grammatical 
markers such as "it 11 or "this" may need to be correctly interpreted to 
enable the reader to follow the writer's argument successfully. Similarly, 
synonymous words (items of lexical cohesion) may need to be recognized as 
such (e.g., "the over spilling of energy" = "the swellings of power" = "the 
overflow") for the reader to understand the text. The extent to which such 
features of cohesion affected the statistical results was examined. 

c . Discourse Analysis 

Discourse analysis of the rhetorical organization of "coherence" of 
a text was carried out to reveal patterns which could be linked to reading 
ease or difficulty. Sentence functions were labeled according to lists 
of sentence types suggested by Horn (197D, Jones and Faulkner (197D, and 
Larson (1 967). The illocutionary force of paragraphs was determined 
according to lists by Austin (1962), Wilkins (1976), and Munby (1978). 
The sentence functions, paragraph-level illocutionary acts, and paragraph-level 
concepts in the texts were examined and compared with the M-C questions 
on the texts to determine whether any particular rhetorical pattern or 
order was more difficult than any other. 



ERLC 



127 



CHAPTER THREE 



119 



1 ) Discourse Analysis of Sentence Functions 
and Paragraph Functions 



In this study, the term "illocutionary force 11 was used to describe 



the macro-level function of a paragraph, whereas the term "sentence function" 
was restricted to the micro-(sentence) level. The patterns that form 
sentences and paragraphs in each text version were examined to determine 
whether some discourse patterns (e.g., contrast, explanation) might be 
easier or more difficult than others (e.g., example, description). This 
method measures the effect of coherence (the organization and relations 
between concepts in the text) rather than cohesion. 

It was assumed that texts whose ideas are complex, or which contain 
a good deal of contrasting or shifting arguments, are more difficult than 
texts containing only one argunent which includes many examples, explanations, 



An analysis of the concepts and structure of each sentence was carried 
out to discover the general conceptual shape of each paragraph and of the 
text as a whole. A diagrammatical breakdown of the texts — according to 
the functions and concepts in each sentence and paragraph — appears in 
Appendix C, Tables 5-10, "Discourse Analysis and Sentence Function." 



and/or descriptions 




2) Paragraph-Level Concepts 
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C. DATA PROCESSING AND ANALYSIS 

1. Flesch Reading Ease Readability Formula 

The formula was applied to the first 100 words of each of the text 
versions (see Appendix C t Table 1, "Texts Ranked According to the Flesch 
Reading Ease Formula"). The resulting scores were placed in increasing 
order to form a hierarchy of difficulty. Scores were exanined for differences 
in difficulty between the original and reordered versions, and between the 
grammatical and lexical text versions. In this study, the former two would 
indicate differences in coherence and the latter two differences in 
cohesion. 

2. M-C Test Results 

a. Item Analysis: Easiness Indices, Mean Scores, 
Reliability 

This study used the ITANA V computer program of Item Analysis developed 
by Nevo et al. (1975) and Ramraz (1979) to analyze results of M-C questions. 
This program provides information on each question as well as on the test 
as a vtiole. It provides mean scores, standard deviations, and reliability 
of the test based on the Kuder-Richardson Formula #20 and the Split- Half 
Formula. (See Appendix C, Table 15, "Results of M-C Comprehension Tests 
1-4 — Cohesion"; Tables 27-32, "Easiness Indices — Tests 1-6. 11 ) 

Especially useful in this research was the Easiness Index (also known 
as Facility Index and Difficulty Index), which represents the number and 
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percent of correct answers for each question for the total test population* 
Using t-test analysis, this study compared differences between the Easiness 
Indices of the identical questions in the grammatical and lexical versions. 
(See Appendix C t Table 14, "Hierarchy of Easiness Indices of Questions 
Related to Sections of Text Containing Cohesive Items.") 

b. Comparison of Student Responses 

For Test3 1-4, scores of doctored versions of tests were compared 
with those of the original versions as well as with each other. For the 
24 doctored versions of the six original texts, t-tests and F-tests (Two-way 
AMDVA of score by year by test type) were used to calculate whether there 
were any significant differences among mean test scores, among Easiness 
Indices of questions, and among responses to specific questions directly 
dealing with sections of doctored texts. (See Appendix C, Table 18, "Results 
of M-C Qjestions on Texts Doctored for Grammatical and Lexical Cohesion;" 
Table 19, "Coherence ~ Results of M-C Qjestions on Original and Reordered 
Versions of Text;" Table 26, "M-C Questions with Significant 
Differences,") 



3. Cloze Test Results 

Student responses on the cloze procedure were marked by the researcher 
as follows: correct answer = 2, partially correct answer (showing some 
comprehension) = 1, wrong answer or no answer = 0. The percent of correct 
answers, mean test scores, and standard deviations were calculated for 
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each text version. Partial credit was given to words that were not wild 

guesses and that would make some sense in context, even though they were 

not semantically close to the original word (see Appendix C f Table 16, 
"Cloze Findings"). 

4. Discourse Analysis 

a. Frequency of Cohesive Items in Texts 

The frequency and percentage of items of lexical and grammatical 
cohesion in relation to the whole text were calculated for each of the 24 
doctored text versions. (See Appendix C t Tables 2 and 3, "Items of 
Grammatical and Lexical Cohesion in Original and Reordered Texts.") 

b. Illocutlonary Force, Sentence Functions, 
and Paragraph-Level Concepts 

Tables indicating the illocutlonary force, sentence functions, and 
paragraph-level concepts of each of the sentences in the texts were prepared. 
In this way it way it was possible to follow differences in the patterns 
of logical sequencing between original and reordered text versions. (See 
Appendix C, Tables 5-10, "Discourse Analysis.") 
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c. Matching Multiple-Choice Easiness Indice s 
and Discourse Analysis 

For Tests 1-4, charts of cohesive Items were prepared across the three 
# text versions (i.e., the original and two "doctored" versions). (See 
Appendix C f Tables 11-13, "Cbhesive Chains: Graphic Chart of Cohesive Items 
Across 3 Versions of Texts, Comparison of Results of Test Questions;" 
Tables 20-25, "Matching Test Questions with Lexical and Grammatical Items 
of Cohesion in Text: Tests 1-6.") In this way it was possible to compare 
differences in text that were caused by doctoring with student 
responses. 

Easiness Indices were also included in the table of sentence functions 
and illocutionary force so that comparisons between text structure and 
student responses could be made (see Appendix C, Tables 11-13, "Cohesive 
Chains 11 ). Relations were sotght between specific patterns of argumentation 
in the text and the difficulty or ease of the questions corresponding to 
those sections of text (see Appendix C, Table 't7, "Additive vs. Contrastive 
Paragraphs") . 



ERLC 



132 



CHAPTER THREE 



124 



D. SUMMARY 

One purpose of this study was to determine whether advanced EFL 
students 1 difficulty in reading English texts was affected by cohesion and 
coherence. The researcher assumed that it was possible to doctor a text 
so that their cumulative effect could be measured* It was also assumed 
that features of cohesion and coherence would affect students' ability to 
answer comprehension questions on a text. Another assumption was that 
some features of cohesion and coherence would cause more reading difficulty 
than others. It was hoped that differences in test results would be 
statistically significant either on the macro- (whole-text) or the micro- 
(word and sentence) level, or both. 

1. Cohesion 

Six texts were doctored for both lexical and grammatical cohesion. 
The Flesch Reading Ease Readability Formula was applied to each text 
version. Comparisons were made between student responses to M-C questions 
and the doctoring of texts. For the M-C tests, t-tests and F-tests (two- 
way A NO VA of score by year by test type) were used to calculate whether 
there were any significant differences among mean test scores, among 
Easiness Indices of questions, and among responses to specific questions 
directly dealing with sections of doctored texts. These results were 
compared with oral interviews of students who had taken the M-C tests and 
with discourse analysis of the texts. 
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2. Coherence 

The six texts were reordered. Again the Flesch Reading Ease Readability 
• Formula was applied to each text version. For each text, discourse analysis 
techniques were used to reveal patterns of text organization: rhetorical 
sentence function (illocutionary force) and paragraph-level concepts were 
tabulated. Again, tests were administered and comparisons made between 
the researcher's description of the text content and structure, on the one 
hand, and the difficulty or ease of reading comprehension, as reflected 
by student test scores (M-C and rational cloze), on the other. 
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NOTES TO CHAPTER THREE 



1. This assumption* however, was not necessarily alwa/s true. Although 
on the t*iole the tests were reliable, there were some multiple-choice test 
questions that were problematic, either because of unintentional ambiguity, 
or because for some students either the text or the questions, or both, 
were too difficult. These problematic questions could be identified uecause 
either too many of the students (more than 90%) or too few (less than 30%) 
ware able to answer them correctly, and/or because of the low Discrimination 
Index (point-biser ial correlation between the student response and the 
total raw test scores). Questions with a Discrimination Index below .30 
did not discriminate? between better students (those receiving high scores 
on the test as a whole) and poorer students (those with low total test 
scores). Nevertheless, it was decided to use these H-C questions if a team 
of teachers agreed that they were fair, especially since some of the 
questions had low Discrimination Indices in one test version but had 
acceptable (or even high) Discrimination Indices on a parallel test version. 
It was hoped that any isolated defective questions would not significantly 
damage the test design as a whole. 

2. The difficulty of finding significant differences in test scores has 
already been discussed by Baten (1981). In previous research on text 
difficulty, Sim (1979) was able to find that the presence of certain items 
of cohesion in a text made it significantly more difficult for advanced 
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EFL students to read. He argued that students who misunderstood these 
vfcrds had more difficulty than if the words had never appeared. For these 
students, rather than being signals, the markers served as obstacles to 
comprehension. However, Fishman (1978) and Baten (1981), also working 
with text cohesion, were not able to find significant differences in test 
scores. 

3. For their helpful commits and criticism, I wish to thank liana Bousso, 
Lillian (Voebel, Melvin Kornfeld, Batia Laufer, Leslie Levanon, Stella 
Levy, Joyce Livingstone, Marion Lupu, Feigy Rosenfeld, Betty Rozen, Dr. 
Donald Sim, and Miriam Widroan, Dept. of Foreign Languages, Haifa 
University. 

4. In 1980 students took both the experimental mid-year and final 
examinations in January and June. Thus the same students took one of the 
first set (Test 1-4) and also one of the second set of tests (Tests 5 and 
6). 

5. Althopgh as one of the teachers in the Department of Foreign LangUdges 
I could choose the texts for my own students, this number of students 
(approximately 50 per year) was too small to make much difference in the 
total test results. 

6. See Baruch Nevo (1977) "Statistics in Student Admissions," Report No. 
26; Esther Oren (1980) "Candidates to Haifa University 1974-1979," Report 
No y **9 ; Anat Yudfat (1980) "First-year University Students at Haifa 
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University: 1978-1980," Report No. 50 ; Haifa University Selection and 
Assessment (hit, Haifa University. These reports indicated no significant 
variation in calibre of students admitted to Haifa University from 1974 
to 1980. It is assumed that this state of affairs continued until 1982, 
when the testing for this study ended. 

5. This formula is cited by Klare (1963) as "being the one most often 
used and the one on which the most research data are available" (pp. 23 
and 58-59). 

8. Another consideration was that the results of this study could be 
compared with those of a previous study on cohesion that was carried out 
on the same population by Sim (1979). Research by Fishman (1978) and Baten 
(1981) also relied on results from multiple-choice tests. 

9. In the original versions of the texts, blanks were selected approximately 
7-9 words apart wherever possible. Tn the reordered versions, the same 
blank spaces appeared. Consequently, the number of words between spaces 
that occurred across sentences was irregular. Blanks within sentences, 
however, were not affected by the reordering process. 

10. Valuable comments on the writing of the texts were made by Prof. E. A. 
Levenston, Dept. of English, The Hebrew University of Jerusalem, as well 
as by Dr. Shoshana Blum-Kulka, Prof. Andrew Cohen, and the students 
participating in their seminar on Research Methods in Applied Linguistics 
at the Hebrew University. 
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CHAPTER FOUR 



COHERENCE 



A. DISCOURSE PROCESSING 

This chapter deals with the sequencing and reordering of sentences 
in a text. It would be useful at this point to recapitulate the theoretical 
questions that underlie th.'.s study. The research question dealing with 
coherence W as whether the reorganization of information in a text would 
affect reading comprehension for our EFL students. In the literature, the 
distinction is made between meanings and their surface forms or manifestations 
in sentences (Brown 1976, Wilkins 1976). Hence different texts may be 
written to represent alternative versions of a discourse (see Schnotz 1983 
and Chapter Two, B. 1.b., Meanings Encoded as Text , pp. 25-27). Possibly 
these texts differ in reading difficulty. If this is true, readers are 
obliged to deal with both the ideas themselves and the way they are organized 
in a text. 

In the literature there are two distinct opinions about discourse 
processing (see Chapter Two, C.2.b.1)b), Order of Information; Sequencing 
of Proposit ions (Given/New), pp. 62-68). One proposed by Thorndyke (1979), 
Kintsch (1977), Gutwinski (1976), and Strang (1972), among others, argues 
that readers naturally try to impose some meaningful interpretation on a 
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series of given propositions, and even arrange the author's ideas into new 
patterns. Based on the concept of schemata, "the fundamental elements 
upon viiich all processing depends" (Rumelhart, 1980, p. 33), this reading 
theory would include both knowledge itself and information about how thf.s 
knowledge is to be used (Rumelhart, 1980, p. 34). Examples of the kind 
of knowledge recognized are word semantics, logical inference rules, and 
story schemata (Spiro, Bruce, and Brewer, 1980, p. 8). 

According to this view, readers are expected to interpret the text, 
reorgajize ideas if necessary, and provide missing links according to their 
expectations of text structure. Difficulties in reading comprehension might 
occur because readers lack the skill to use the knowledge they have: 

This approach suggests the possibility that some unskilled 
reading may be the result of not knowing how to use and 
interweave knowledge, rather than of a lack of knowledge 
itself. (Spiro, Bruce, and Brewer, 1980, p. 8) 

Another view, set forth by Meyer .(1975), Wlddowson (1978), Fishman 
(1978), Kieras (1978), van Dijk (1980), Beaugrande (1980), Baten (1981), 
and Schnotz (1983), among others, states that text readability is affected 
by the order in which information is received. 

The suggestion that both processes occur together has been proposed 
by Adams (1980), Spiro (1980), and Auble and Franks (1983). Comprehension 
is seen as the interaction between top-down processing from activated 
scher.;a and bottom-up processing from concepts expressed by the sentence 
(Auble and Franks 1983). A top-down text (main idea first, then less 
important ideas) appears to be easier to recall than one that is bottom- 
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up (least important ideas first) (Meyer 1975 and Kieras 1978). The number 
of reorganizations necessary to process information may also contribute 
to reading difficulty (Baten 1981, p. 17). 



The concept of top-down/bottom-up text structure is also applied to 
the reading process as described by Adams (1980): 



For the skilled reader, top-down and bottom-up processing 
are occurring at all levels of analysis simultaneously 
as she or he proceeds through the text. The reader is 
therefore able to make optimal use of the information 
on the page, the redundancy of the language, and the 
contextual environment with minimal effort. The top- 
down processes ensure that lower order information that 
is consistent with the reader's expectations will be 
easily assimilated, as it will already have been partially 
processed. Meanwhile, the bottom-up processes ensure 
that the reader will be alerted to any information that 
is novel or that does not fit her or his ongoing hypotheses 
about the content of the text. (p. 12) 



It has been found that truly fluent readers are able to infer the 
complete message in a text, even when not explicitly stated (i.e., Inferring 
a full clause from a single adjective, reorganizing information, etc.). 
The not-so-fluent readers, however, are not able to do so (Meyer 1975 and 
Glock 1978-79). Another study by Meyer, Brandt, and Bluth (1980) found 
that good readers are able to process top-level structure of text, whereas 
the others are not. 

One problem with this kind of research is that even though changed 
word order might make a text more difficult to process, this difficulty 
might still not affect performance on comprehension questions (Baten 1981) 
or would not quantitatively affect recall severely enough to be detected 
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(Beaugrande 1980). We did not know, therefore, at the start of our research, 
whether quantitative, measurable differences in difficulty would be elicited 
by our research methods. 

B. REORDERING AND DIFFICULTY 

1. Original vs. Reordered Texts 

The sentences in six texts were reordered so that the texts still 
made sense but were structured differently. Except for a few unavoidable 
instances, none of the v*>rds in the texts was changed — only their position 
in the text. There were two versions of each text: original and reordered. 
(See Appendix C, Table 4, "Key to Rearranged Sentences: Reordered 
Coherence.") 

The difficulty of each of the text versions was measured by the Flesch 
Reading Ease Readability Formula (see Chapter Three, B.2.a., p. 3), the 
rational modified cloze procedure, and test results of multiple-choice 
(M-C) questions accompanying the texts. 

a . Flesch Reading Ease Readability Formula 

The Flesch Reading Ease Readability Formula was applied to the first 
100 words of each text. Results of the formula for Texts 1-6 show no 
difference between original and reordered versions (chi-square test for 
goodness of fit: chi-square = .33, P = n.s. See Appendix C, Table 1, 
"Texts Ranked According to Flesch Reading Ease Formula"). 
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b. Rational Cloze Procedure 

Words deleted by the researcher were those that could be reasonably 
% guessed from the contextual clues. The same words were deleted for both 
original and reordered versions. The distances between deleted words 
varied, therefore, in each of the versions. The undoctored (original) 
versions of Texts 1-3 were used. The number of blanks for Texts 1, 2, and 
3, was 46, 38, and 50, respectively. A total of 186 students were 
tested. 

Test results showed that the reordered versions were significantly 
more difficult than the original versions (F z 1 . 64, df s 97 and 88, p<.05; 
t = 4.36, df = 184, p<.0001, see Appendix C, Table 16, "Cloze Findings"). 
An examination of each text separately showed a significant difference for 
Texts 1 and 2 (F = 3.00, df = 28 and 33, P<.005); and t = 5.07, df = 55, 
p<.0001, respectively 1 ), but no significant difference for Text 3 was 



Two different test batteries were administered: Tests 1-4 as a 
mid-year exam after 50 hours of instruction, and Tests 5-6 as a more 
difficult final exam after 100 hours of instruction. Each test was 
accompanied by 20 M-C questions; there was a total of 120 questions for 
all six exams (see Appendix C, Tables 4a and 4b, "Parallel Questions") . 

A significant difference was found between (M-C) test scores of 
original and reordered versions of the six texts. A comparison of overall 
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c. M-C Tests 
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test results yielded the following results: t = 2.37, df = 22, p<.05. 
Comparing the separate questions in each test version, we also found 
significant results: t = 3»31, df = 956, p<.001; F = 10.95, p<.001. There 
was a significant difference between the Easiness Indices of the original 
and reordered versions for 38 questions (32? of the total 120 questions). 
(See Appendix C, Table 19, "Coherence — Results of M-C Questions on 
Original and Reordered Versions of Texts," and Table 26, "M-C Questions 
With Significant Differences,") 

T-tests were applied to the separate questions according to version 
(e.g., the results of Giestion 1, for example, in both the original and 
reordered versions, where this question may be called by another number, 
such as Question 9). Tt was found that for 38 questions (32?) of the total 
120 questions (6 texts, 20 questions each), there was a significant 
difference between original and reordered text versions. 

Of these 38 questions, F-tests showed that for 22 questions (58?) , 
the reordered versions were harder, for 12 questions (32%) the original 
versions were harder, and for H questions (10?) the Easiness Indices were 
on the same level for both original and reordered versions. Of these 38 
questions, only 12 were also foind by t-tests to have significant differences 
between original and reordered versions. A total of 25 questions (21?)* 
were found significantly different by t-tests: for 18 questions (72?) the 
reordered versions were harder, but for 7 questions (28?) the original 
versions were harder. Thus F-tests showed more questions to be significantly 
different in each version than did t-tests (see Appendix C, Table 26). 

ERIC 143 



CHAPTER FOUR 135 

From the total 120 questions t those found significantly different 
were relatively few: the reordered versions were harder for 22 questions 
t (19%) according to F-tests, and for 18 questions (15%) according to t- 
tests; the original versions were harder for 12 questions (10%) according 
to F-tests, and 7 questions (6%) according to t-tests. 

It i.x assumed that many of the questions yielded significant results 
by chance. That is, they were found statistically significant by F- tests 
and/or t-tests by coincidence, as a result of the large number of question 
pairs, but not because of the questions themselves or the sections of text 
they accomapny. For this reason, these questions were not examined further. 
Nevertheless, these results on separate questions confirm the findings of 
the F-tests and t-tests for overall test results, namely, the reordered 
versons were generally found to be more difficult than the original. 

d . Effects of Reordering 

It may be concluded from these results that the reordered versions 
were more difficult than the original versions of text. Therefore, for 
our EFL students, the sequencing of information has been shown to affect 
readability or reading difficulty. 

Reordering the texts appeared to affect five aspects of discourse: 

cohesion, sentence functions, paragraph-leveL concets, illocutionary force, 

and top-down/bottom-up structure (see. Appendix C f Tables 5-10, "Discourse 

A 

Analysis"). It has been established that reordering sentences is a procedure 
that significantly affects text readability (i.e., affects Easiness Indices 
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of M-C Test scores). At this point it was not clear whether the reordering 
procedure made the texts easier or harder to read. Now these five aspects 
were examined to determine how each one contributed to the total change 
during the reordering process. 

2. Effects of Reordering on Text Cohesion 

One way of looking at cohesion is to see it as not directly related 
to coherence (Widdowson 1978, Tierney and Mosenthal 1980 and 1981, Carrell 
1982). That is, texts may be coherent without necessarily being cohesive, 
and vice versa. Another view of cohesion is that it may be one aspect of 
coherence (van Dijk 1977c, Baten 1981 , Langleben 1981). During the course 
of this research study, we found it necessary to take into account the 
effect of cohesion on the reordering process (see Appendix C, Tables 2 and 
3, "Items of Grammatical and Lexical Cohesion in Original and Reordered 
Texts" and Tables 20-25, "Matching Questions With Lexical and Grammatical 
Items of Cohesion in the Text 11 ). 

The Easiness Indices of questions relating to sections of text that 
had been doctored were examined separately. The researcher investigated 
the interaction effect between questions relating to sections of text 
containing grammatical or lexical cohesion, on the one hand, and original 
or reord^-ed sentences in the text, on the other (see Appendix C, Tables 
27-32, Easiness Indices: Tests 1-6"). F-tests (ANOVA) comparing the 
interaction effect between cohesion and coherence were not significant. A 
comparison of all six tests showed the F-value to be 1.96 (df = 47, p = 

EJ$C 145 



CHAPTER FOUR 



137 



n.s.); looking at each of the components separately, we found the F- value 
for reordering to be 5.^3 (df = 1 t p<.05), the F-value for cohesion to be 
• 31 (df = 1 t p = n.s.) t and the interaction F-value to be .09 (df = 1, p 
= n.s.). Examining each text separately, we found no significant 



Nevertheless, looking at Tables 20-25, "Matching Test Questions with 
Lexical and Grammatical Items of Cohesion in the Text, n we see th the 
same questions Include features of cohesion in the original version that 
may not appear in the reordered version, and vice versa* In other words, 
the reordering process has affected not only items of cohesion but their 
related questions as well. Thus, in the grammatical version of Text 1, 
Question 8 contained grammatical repetition in the original version; 
however, in the reordered version Question 8 contained reference instead 
of grammatical repetition. In th^ lexical version, Questions 2 and 7 were 
related to sections of text containing synonyms in the original version 
which changed to lexical repetition in the reordered version. Question 
10 contained lexical repetition in the original version and a synonym in 
the reordered version. Hence in Text 1 the reordering process affected 
four of the twelve questions relating to sections of text containing 
cohesion. In Text 2 there were changes in all of the ten cohesion- related 
questions; in Text 3 in seven of the fourteen questions (nos. 1, 2, 7, 8, 
12, 1 3t and 18); in Text H in six of the thirteen questions (nos. 1, 4, 
7, 9, 11t 12); in Text 5 in thirteen of the sixteen questions (nc3. 1- 5, 
9-1, 13-16, and 18); and in Text 6 in sixteen of the eighteen questions 




(nos. 1-3, 5-13, 15-18). 
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Examining the total number of questions involved in cohesion for each 
version, we observed different patterns, depending on the texts. In Text 
1 there was no real difference in the total number of questions for any 
version* For Text 2, original grammatical and lexical versions had the 
same number of questions. The reordered version of Text 2, however, 
contained fewer questions, and the numbers were different for grammatical 
and lexical versions. In Texts 3 and 4, there was the further complication 
that the doctoring procedure changed the text versions each year. For 
these texts the differences between question Easiness Indices resulting 
from the doctoring procedures appeared to be greater than the differences 
involved in features of cohesion. In Text 5, the original grammatical 
text had few?r questions relating to cohesion than any of the other versions. 
In Text 6, It was the original lexical version vtith the fewest number of 
questions relating to cohesion. 

What is obvious from the results of t-tests and F-tests is that 
questions were affected by the changes in text. These differences in 
questions may reflect the doctoring procedure, in which features of cohesion 
were changed, or the reordering process, in which the order of the sentences 
was changed, or to both of these factors. The fact that significant results 
were obtained indicated that the M-C tests were sensitive to changes in 
discourse structure. 

Let us examine the opening section of Text 2 and its related questions 
v*iere such changes occurred. Appendix B contains all versions of Text 2. 
The sections pertinent to our argument will be presented here. 
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Text 2 — original coherence, grammatical cohesion 



World population growth — and how to slow It — 
continues to be a subject of great controversy. The 
world's poorest nations have yet to find effective ways 
to slow this growth — at least without restricting 
citizen3 f rights and violating such traditions as the 
one of having large families as insurance in old age. 
Population growth is the gravest problem the world faces 
over the decades immediately ahead. In many ways it is 
an even more dang— ous and subtle threat than war, since 
it is less amenable to organized control. It is not in 
the exclusive control of a fow governments, but rather 
hundreds of millions of individual parents. It must be 
faced — like the nuclear threat — for what it is: a 
central determinant of mankind's future, one requiring 
far more attention than at present. 



Text 2 — original coherence, lexical cohesion 



World population growth — and how to slow it — 
continues to be a subject of great controversy. The 
planet's poorest nations have yet to find effective ways 
to check this population increase — at least without 
restricting citizens* rights and violating such traditions 
as the custom of having large families as Insurance in 
old age. Population growth is the gravest issue the 
world faces over the decades immediately ahead. In many 
ways an increase in the earth's population is an even 
more dangerous and subtle threat than war, since a rise 
in the nunber of the world's inhabitants is less amenable 
to organized control. The problem is not in the exclusive 
control of a few governments, but rather in the hands 
of hundreds of millions of individual parents. The 
population threat must be faced — like the nuclear 
threat — as a central determinant of mankind's future, 
a problem requiring far more attention than is presently 
given. 
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Text 2 — reordered coherence, grammatical cohesion 



Last year the world f s population passed H billion. 
While the growth rate in the developed nations is actually 
slowing down, in the developing countries it is accelerating 
rapidly. It is the gravest problem the world faces over 
the decades immediately ahead. Unless there is a holocaust 
brought on by man or nature, it will continue. The 
problem, then, is to slow this down in the developing 
contries where fertility is high. 



The world f s poorest nations have yet to find effective 
ways to check this growth — at least without restricting 
citizens 1 rights and violating such traditions as that 
of having large families as insurance in old age. A 
number of governments are moving in the direction of 
coercion. 



Text 2 — reordered coherence, lexical cohesion 



Last year the world 1 s population passed U billion. 
While the growth rate in the developed nations is actually 
slowing down, the rate in the developing countries is 
accelerating rapidly. Population growth is the gravest 
issue the planet faces over the decades immediately 
ahead. Unless there is a holocaust brought on by man 
or nature, the process will continue. The problem, then, 
is to control the population growth in the developing 
countries where fertility is high. 



The globe's poorest nations have yet to find effective 
ways to check the population increase — at least without 
restricting citizens 1 rights and violating such traditions 
as the custom of having large families as insurance in 
old age. A number of governments are moving in the 
direction of coercion. 
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Question 1 (original version) s Question 3 (reordered version) 



According to these lines t the poorest countries 

1. have found ways to slow down population growth 

2. have not found ways to slow down population growth 

3. don f t want to find ways to slow down population growth 

4. will soon find ways to slow down population growth 



Examining what students are required to understand when answering 
this question, we see that in the grammatical version, they must interpret 
"have yet to find" to mean "have not yet found, 11 and discover the anaphoric 
referent of "growth." In the original grammatical version, "this growth" 
(line 4) refers back to "it" and "world population growth (line 1). In 
che reordered grammatical version, however, the cohesive ties are much 
more indirect. From "this growth" (paragraph 2, line 11), readers must 
return via "this" (line 8), and "it" (lines 4 and 7 — twice), to the 
referent, which is implied but not clearly stated: "the world's population" 
(line 1), "the growth rate ... is actually slowing down" (lines 2 - 
3). 

The situation is slightly different in the le/ical versions. Tn order 
to answer the M-C question, students must recognize the equivalence, in 
the original version, of "population increase" (line 4) and "populatiion 
growth" (line 1). The features of cohesion involved are repetition of 
"population" and the synonyms "growth" and "increase." Tn the reordered 
version, the cohesive links between the two sentences are the same as in 
the original version, even though the sentences themselves are different. 
Again, "population increase" (line 12) refers back to "population growth" 



q (lines 5, 9). 
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This example shows that when sentences were reordered, the markers 
of cohesion did not necessarily stay the same. There was no statistical 
evidence, however, that changes in cohesion affected the reading difficulty 
of the questions accompanying the reordered texts. This lack of significant 
difference does not clarify the relation between cohesion and coherence. 
It does, however, show that by reordering sentences one does more than 
change the order in which ideas are presented. One thereby also changes 
the cohesive links binding those sentences together. Thus the evidence in 
this study tenJs to confirm the approach that sees cohesion as an aspect 
of coherence. 
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3. Effects of Reordering on Discourse Patterns: 
Sentence Functions, Paragraph-Level Concepts, 
Illocutionary Force 

a. Discourse and Focus 



The process of reordering the sentences affected the order in which 
information was presented. Changes occurred on the sentence and paragraph 
levels as well as on the whole-text level. The term "sentence function" 
will apply to the sentence level, and ?, illocutionary force" will relate 
to the paragraph and whole-text levels. Sentences were categorized according 
to the classification of logical relationships by Horn (1971). (See Tables 
5-10, "Discourse Analysis.") On the sentence level, the reordering process 
sometimes altered the function a sentence, which is determined not only 
by the sentence it^lf but also by the sentences preceding and following 
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it. For exanple, Text 2, Sentence 6 consists of an answer in the original 
version and a contrast in the reordered version (see Appendix C f Table 6). 
Sentence 8 is a contrasting fact in the original version but a simple 



statement of fact in the reordered one. According to Table 6 t Sentence 
11 presents tw separate results, functioning as a contrast in the original 
version but having the function of amplification and cause/effect in the 
reordered version* 

On the paragraph level, content and illocutionary force are also 
altered. Often the illocutionary force is indirect, being inferred from 
the context without explicit cohesive markers, In the reordered version, 
the illocutionary force of each paragraph is different; beginning with 
the statement of the problem, it progresses directly to a discussion of 
the solution and its results, and it ends with a restatement of the 
problem. 

The cumulative effects of these changes on the paragraph level are 
to change the focus on the general whole-text level. Whereas the original 
version ends on a positive note, giving a clear solution, the reordered 
version ends on a threatening note. The impact on the reader of the 
reordered version, although containing the same information, is 
different. 

Only Text 3 has no change in focus between original and reordered 
versions. This stability is due to the fact that Text 3 contains a static 
description of a situation. The writer is not trying to persuade the 
reader of a point of view; the tone of the text is relatively neutral. 
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An examination of the endings of th other texts will reveal the 
differences in focus. In Text 1, both versions are hopeful. The original 
version ends on the note that physiological and psychological factors 
enable the elderly to keep themselves active, whereas the reordered version 
ends with the hope that help will come from scientific techniques (e.g., 
drugs and psychotherapy). In the original version of Text 4, the solution 
is important and appears near the end of the text. In the reordered version 
the solution is de-emphasized by being placed in the middle of the text, 
while the ending deals with a neutral identification of sources of money. 
In Text 5 it is an implied threat that is de-emphasized by being placed 
in the middle of the reordered version. The impact of the original version 
is negative, showing cause for dissatisfaction, whereas the reordered 
version neutrally presents an unequal situation. The original version of 
Text 6 is positive, dwelling on the development and progress resulting 
from the fr lotion between cultures. The reordered version, however, ends 
with the implicit resentment of the subjugated peoples who live in a 
cultural vacuum. 

Tn one case, during the testing, the reordering procedure resulted 
in a need for changing the correct answer. In the original version of 
Text 6, the correct answer for Question 19 was no. 4, whereas in the 
reordered version the correct answer was no. 2. 
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Question 19: 

From a history of relationships between civlizations the writer 
concludes that 

1. colonialism and imperialism are wicked and ought to be 
punished by revolution 

2. all civilizations, without exception, must go through periods 
of origin, growth, achievement, and decay 

3. the Oriental and Western civilizations will forever remain 
in conflict and will eventually decay 

4. in order to avoid decadence, friction rnd the clash of 
contrasting ideas are absolutely essential 

This change in correct answer was due to the change in focus between the 
two versions. The mean Easiness Index for Question 19 in the original 
version was 37X and in the reordered version 3U. It was a difficult 
question in each version. 

These changes in focus resulted from differences in paragraph- level 
and illocutionary force throughout the text. The end of the text, receiving 
the cumulative effact of the previous paragraphs, took on a special 
significance. The very position of certain sentences either at the beginning 
or end of a text caused them to take on a significance that they would not 
ordinarily have if they were placed somewhere in the middle of the text. 
Thus by shifting the focus, the reordering of sentences, to a certain 
degree, also affects illocutionary force and concepts in the text. 
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b. Additive vs. Contrastlve Paragraphs 



Among the different types of sentences and paragraphs, the researcher 
paid special attention to those whose functions were additive or contrast! ve. 
In additive paragraphs , an idea is explained and examples given to argue 
a certain point of view or describe a given situation. In conrastive or 
comparative paragraphs, alternative points of view are expressed, comparisons 
are made between objects, or there may be reservations or disagreement. 

According to the literature, connectives in general may be a source 
of difficulty (Cohen et al. 1979, Sim 1979, Baten 1981). One reason may 
be cultural. Kaplan (1966) found that in Arabic almost all the ideas are 
coordinatively linked with little subordination, whereas in English far 
more subordination is part of the convention of expository writing. Ihis 
phenomenon may cause connectives to be especially problematic for those 
of our students who are native speakers of Arabic. Another reason may be 
that it is more difficult to process discourse that contains shifts, 
nuances, contradictions, and reservations than it is to process straightforward 
ideas that are amplified. Additives could be considered the simplest 
connectives. Sim (1979) found contrastive function words more difficult 
than causal and conclusive function words (p. 187). 

Assuming that a single, continuous line of thought would be easier 
to **ead than a sequence of sentences containing contrasts, the researcher 
examined questions touching on changes in such sections of text. For 13 
of the 120 questions (11J), a change lu the type of sentence function 
occurred during the reordering process (see Appendix C, Table 17, "Additive 
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vs. Contrastive Paragraph s w ) . lhis change of function was not intentional 
on the part of the researcher. It was a by-product of finding another, 
alternative order in which to place the sentences so that they would still 
make sense. 

Sometimes when additive sentences in the original version were 
reordered, they became part of contrastive paragraphs in the reordered 
version, and other times contrastive sentences and paragraphs in the 
original became additive in the reordered. In other words, neither additive 
nore contrastive paragraphs were particular to either the original Jjor 
reordered version. Although this phenomenon did not explain why the 
reordered versions were generally more difficult, nevertheless it was worth 
exanining. This by-product of the reordering process yielded an opportunity 
to compare the effects of sentence function on reading difficulty. 

Those questions that involved sentences whose functions did not change 
fVom additive to contrastive, or vice versa, after the reordering process, 
were not examined, since these would not affect the comparison between the 
original and reordered versions. The Easiness Indices for only those 11 % 
of questions involving a change in sentence function were compared by means 
of a t-test. Since there was no particular plan to place specific types 
of sentence function in any one version, both additive and contrastive 
paragraphs appeared in both original and reordered versions. The spread 
was uneven: of the thirteen questions found to touch on those sections 
of text v#iere sentence function changed, nine were additive in the original 
version and contrastive in the reordered, and four were additive in the 
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original version and contrastive in the original. That is t there were 
five more contrastive paragraphs in the reordered versions than in the 
original. Moreover, this phenomenon did not occur in all six texts: for 
Texts 1 and 2, reordering did not change illocutionary force» Additive 
and contrastive paragraphs stayed the same t regardless of text version. 

tbssibly, this difference between contrastive and additive paragraphs 
may be reflected by the results of t-tests and F-tests (see Appendix C t 
Table 19, "Coherence — Results of M-C Questions on Original and Reordered 
Versions of Text"), The results of Tests 1-6 were broken down into mid- 
year exams (Tests 1-4) and final exams (Tests 5-6)* For Tests 1-4, no 
significant difference was fowd between the original and reordered versions^ 
For Tests 5-6, however, results of both t-tests and F-tests were significant 
(t = 2.37, df = 515, p<.05; F = 4,70, df = 516, p<*05). 

Comparing thirteen pairs of questions, regardless of text version, 
the researcher found a significant difference between Easiness Indices of 
questions related to contrastive paragraphs and those related to additive 
paragraphs. The additive paragraphs were easier (t = 2.28, df = 12, p<»05)* 
These Endings are in line with theories by Kintsch et al . (1975), Kintsch 
and Vipond (1977), Kieras (1977), Fishman (1978), Sim (1979), and Baten 
(1981) that texts or paragraph containing repetition or restatement of the 
same main ideas or an addition to an initial chunk of information are 
easier to read than texts or paragraphs including many different ideas or 
propositions. 
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There are three limitations to this finding. First, 11? of the 
questions is a very small nunber and indicates a marginal effect. Secondly, 
this effect does not necessarily point to the difference between the 
original and reordered versions — only to a clearly distinct phenomenon 
involving additive and contrastive illocutionary force. The fact that there 
were five more occurrences of contrastive paragraphs in the reordered 
versions than there were in the original version does not necessarily 
explain the reason why the reordered versions were more difficult. Thirdly, 
this finding measures the text only indirectly; it is based on questions 
related to stretches of text. In fact, more of these changes occurred in 
the text (see Tables 5-10), but were not indicated for lack of suitable 
questions, Tius the method of using Easiness Indices does not faithfully 
represent the frequency or extent of the changes. It does, however, 
indicate trends and permits us to measure their effects on text 
difficulty. 

The following examples from the texts may help illustrate what happened 
in the reordering process. (Only the versions of grammatical cohesion 
will be shown; the same phenomenon hotds true for the lexical versions 
also.) 

Text 6, original version, paragraph 1 

In studying the history of relationships between 
East and West, we come to realize that there have been 
alternating phases of Oriental and Western ascendancy. 
Periods of high cultural development have lasted from 
one to two thousand years (more or less), and scholars 
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can break down these periods into: origin, growth, 
achievement, and decay. And whatever the height or 
splendor of their flowering, all civilizations known to 
us have ended in a decline. 



Text 6, reordered version, paragraph 5 



• In studying the history of relationships between 

East and West, we come to realize that there have been 
alternating phases of Oriental and Western ascendancy. 
For East and West, these periods have never been 
simultaneous. Instead, they have alternated, the decadence 
of one coinciding with the highest achievements of the 
other • 



Question 1 (original version) = Question 11 (reordered version) 



In these lines, the writer states that 



1. there has always been conflict between East and West 

2. phases of Oriental decadence have coincided with Western 
ascendancy 

3. civilizations in the East and West have developed during 
the same period 

4. although Oriental civilizations have flourished and 
decayed, Western civilization is still at Its height 



The original version is smooth. It begins with a general statement 
that is amplified and followed to a result. A contrast is also implied 
between the end of a civilization and its period of height. The answer to 
Question 1 is no. 2 which focuses on the "alternative phases" between East 



ERLC 



159 



CHAPTER FOUR 



151 



and West. This fact is presented as an interesting point and a neutral 



In the reordered version of Text 6, paragraph 5 begins with the 
original first sentence which exemplifies the preceding text. Its function 
here is to conclude an argument, not to initiate one. Moreover, while 
amplifying the first sentence, each of the other two sentences in paragraph 
5 contrasts with the previous one. It is not a smooth paragraph. The 
phases are "alternating" not "simultaneous;" "instead" one coincides with 
the other. In the original version, the mean Easiness Index of Question 
1 was 67%; in the reordered version it is 50? (new Question 14). The 
contrastive paragraph was more difficult than the additive. 

Another example is the first paragraph of Text 5. (This time the 
versions of lexical cohesion will be used.) 

Text 5, ori ginal version, paragraph 1 



When economic growth slows down, the process that 
is happening now, we will finally have to face the problem 
that the myth of a one-class society has obscured — the 
problem of what to do about the working class, not to 
mention the poor, who have the temerity to ask for "more," 
and to be discontented even after getting more. This is 
an attitude that the middle and upper classes celebrate 
in themselves, but deplore in other groups. It is, 
however, an attitude that can be tolerated as long as 
everyone gets more, because growth benefits all 
classes. 



opening. 
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Text 5, reordered version paragraph 1 

Although social and political differences are very 
great throughout the Western world t income structures 
are much alike. The top 5 percent get only 15 percent 
of all income. The lower class is condemned to live on 
5 percent of the nation's income. Moreover, there is the 
problem of What to do about the working class, not to 
mention the poor, who have the temerity to ask for "more," 
and to be discontented even after getting more. The 
working class, for this reason, must come into conflict 
with the middle class. Of course, the proletariat will 
also struggle against the upper class and the rich. And 
the bottom 20 percent of the population, the group with 
virtually everything to gain and almost nothing to lose, 
will be fighting against both the upper third of the 
country and the working class. The struggle of the lower 
classes is an attitude that the middle and upper classes 
can tolerate as long as everyone gets more, because 
growth benefits all classes. This is an attitude that 
the richer classes celebrate in themselves, but deplore 
in other groups. 



Question 1 (original version) = Question U (reordered version) 

The problem of the working class and the poor is caused by 

1. 3n increase in economic growth 

2. a decrease in economic growth 

3. the myth of the one-class society 

4. the surplus income of the rich 



Again, for these paragraphs, the original version is smoother than 
the reordered one. It also contains fewer examples/factc. The first 
paragraph in the original version of Text 5 contains two contrasts: 1) 
the working class and poor vs. the middle and upper classes, and 2) the 
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attitude that is tolerated during periods of growth but not during periods 
of economic decline. The first paragraph of the reordered version contains 
the same sentences in addition to six new ones. These sentences add 
contrasting facts so that each sentence contrasts with the previous one. 
In the original version the mean Easiness Index for Question 1 was 71?; 
in the reordered version it was 50%. Apparently, the numerous contrasting 
facts obscured, at least in part, the main point of the paragraph, which 
is response no. 2. 



4. Top-Down vs. Bottom-Up Paragraphs 

It has been shown that text recall is affected by paragraph structure 
(Meyer 1975, Kieras 1978). The easiest structure to recall appears to be 
top-down structure, where the first sentence gives the most important 
ideas, and subsequent sentences contain less important ones. When the 
secondary ideas begin a text (bottom-up structure), the tsxt was found 
harder to follow and to recall. Qi the sentence level, superordinate 
clauses were found easier to recall than subordinate clauses (Bever 1972, 
d'Arcais 1978, Kieras ^978, Bever and Townsend 1979, and Baten 1981). 

Researching the reading orocess of high school native English speakers, 
Meyer, Brandt, and Bluth (1980) found that good readers have no trouble 

in following top-level rhetorical structure, (e.g., problem/solution, comparison, 
antecedent/consequent, description, and collection (including sequence)), but weaker 
readers cannot do so without help. Thus, to facilitate reading, it is preferable 
that the important 
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ideas appear first. Lar^ problans on ^ ^ ^ 
E?L Earners from deriving macro-structures (Widdowson, 1980, p. 242). 

Sis terminology in describing teIt structure ia parallelcd ^ ^ 
of tha reading process. Reading comprehension is seen as the interaction between 
top-down and bottom-up processing by Auble and Pranks (,«,). Naders m, be 
assumed to simultaneously perceive and reiate to general ideas in a text (top-down) 
and particular detaiis (bottom-up). Moreover, inefficient processing of eitber kind 
i ma, impede reading comprehension (Spiro 1980): 

SeTso^^Tof'idean *" S?** ** Vari °" S > r °< ess « ° f comprehension 
consjra^ l^in^^J^ - real-ti™ 

jsns^sssft" 5) to readi,,s defioicncy - ^^oies'ir 

Although these studies were carried out on native speakers of English (except 
for the study by Widdowson, they aiso have appiications for our EF1 students. The 
results of the present research study may direct us to inquire whether, for EPL students, 
top-down text structure .ay not be easier to process than bottom-up text structure. A 
text which has top^own structure may give the reader an immediate framework, otherwise 
the reader may need to make the additional effort of deriving the framework (macro-strucLres) 1 
from the micro-structures in a bottom-up text. Vheraas good readers may do this automatically, 
poor readers may not be ab!e to arrive at the macro-structures without additional he!p. 

A sample of the first paragraphs of each of the six texts was examined for top-down/ | 
bottom-up structure. Por Texts ,,2,5,^6,^ original version began with top-down i 
structure, whereas the reordered version of these texts began with bottom-up structure. 
(For Text 5, both versions began bottom-up, and for Text 4, both versions began top-down. 
Conse,uently, these texts were considered separately.) 2 T-tests were applied to the 

l ° f — ~»* to the first paragraphs of original and 

I reordered versions. For Texts 1 2 R and c «, 

| o structure, and the reordered version carried 0T1 ^ Ti&1 vers i°n contained the top-down 
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the bottom-up structure. A significant difference was found between top- 
down and bottom-up beginnings (t = 2.72, df = 8, p<.05). 

To illustrate this point, the first paragraph of Text 1 is quoted 
below. The beginnings of Texts 2, 5, and 6 have already been quoted above 
— see section 2., pp. 139-140, for Text 2 and section 3.b., pp. 1^9- 152 
for Texts 5 and 6. 

a. Original vs. Reordered Versions 

For Tests 1, 2 t 5, and 6, then, there were significant differences 
between the Easiness Indices of questions relating to hhe first paragraphs 
of the original and reordered versions. Below are the original and reordered 
versions of the first paragraph of the grammatical version of Text 1: 

Text 1, original grammatical version 



For all of medicine's skills, old age is as inevitable 
now as it was 2,000 years ago. The most conscientious 
exercises, careful diet and cautious life style cannot 
halt the gradual hardening of the arteries, the reduced 
output of critical hormones, the death of brain cells. 
These holding actions, including face-lifts and skin 
treatments, are ultimately futile. They do not stop the 
stiffening of tissue that causes wrinkling; they only 
disguise it. 



Text 1, reordered grammatical version 



As models of fitness in old age, researchers like 
to point to the inhabitants of the Abkhazia region of 



ERIC 




CHAPTER FOUR 156 

Soviet Georgia. Many of these mountain people are still 
active, working their gardens, riding horseback, bathing 
in icy streams, well into their 80*3 — and not because 
they only like natural foods. Dr. Meander Leaf, who 
spent time with them, attributes their vipor to diet 
(low fat, high protein, fewer calories), exercise and 
the right genes. As Author-Physician Leopold Bellack 
points out: "Seme people who are chronologically 80 are 
biologically only 60. Their bones, eyes, ears, skin — 
even reflexes and blood pressure — may be those one 
expects in a 60-yeai -old." 



In the original version, the first paragraph of Text 1 begins with a 
general statement of the problem of the inevitability of old age which is 
amplified and described in the remaining two sentences of the paragraph. 
The entire paragraph is a general description without specific details or 
examples. In the first paragraph of the reordered version, none of the 
sentences of the original first paragraph appears. The paragraph begins 
with an example of the remarkable activity of certain elderly people, which 
is amplified by more detail in the two following sentences. The final two 
sentences give additional details, and the point is made that the physical 
appearance of the edlerly can be relatively youthful, given the proper 
conditions. 

The content and emphasis of each of these initial paragraphs is 
slightly different even though the subject is the same. Their structures, 
however, are very different. The original version contains statements of 
top-level structure, whereas the reordered version presents details and 
information without stating the general assumption on which they are based. 
Tt is up to the reader to infer the general assumption that under certain 
conditions old people look and act younger than they are (see Appendix C, 
Table 5). 
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Ihe original version of Text 2 (see above 2., pp. 139-140) also begins 
with a general statement of the problem which is amplified. The writer 
then presents his opinion that population growth is a world threat. The 
same idea is restated five times in the first six sentences. The first 
paragraph of the reordered version begins with a neutral fact. It is 
followed by another fact, and then the writer f s opinion of the threat of 
poopulation growth, the same as appeared in the original version. This 
point is followed by the foreseen result, and the paragraph concludes with 
the formulation of the problem. 

In the first paragraph of the original version, the top-level idea 
(i.e., the statement of the problem) comes first; in the reordered version 
it appears last (see Table 6). Furthermore, three of the sentences from 
the first original paragraph appear in the last paragraph of the reordered 
version. Coming at the end of the text, these three sentences, which 
contain the key top-level concepts, weight the whole text so that it is 
bottom-up rather than top-down. The effect, then, is not limited to only 
the first paragraph. (For the entire texts, see Appendix B.) 

The first paragraph of the original version of Text 5 (see above 3.b., 
p. 151) begins with a general statement, followed by some opinions about 
it with a contrasting comment by the writer. It presents the problem. The 
reordered version begins with a qualified fact which is followed by two 
more facts. There follows half a sentence that also appears in the first 
paragraph of the original version and then three facts/results. The paragraph 
ends with the two sentences that were included in the original. Thus most 
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of the original version appears in the reordered paragraph. The intervening 
sentences, however, emphasize the details rather than the problem itself. 
Thus the reordered first paragraph includes proportionately more bottom- 
level structure than the original (see Table 9). 

The first paragraph of the original version of Text 6 is a very general 



overview of the process of civilization. The first paragraph of the 
reordered version, however, argues that conflict is the cause of progress. 
None of the sentences of the original version appears in the reordered 
one. These paragraphs have already been discussed above (3.b., pp. 149- 
153) where the structure of the original paragraph was considered to be 
additive and the reordered paragraph to be contrastive. Tt is hard to say 
whether the difficulty of the reordered Question 14 was due to the contrastive 
structure of the reordered paragraph or because the reordered version 
contained a larger number of less important ideas than the original (i.e., 
had bottom-up structure rather than top-down structure). Possibly, a 
combination of the two factors affected the M-C test question (see Table 



For Texts 3 and 4 f on the other han^, there were no significant 
differences between Easiness Indices of original and reordered versions. 
One reason for this similarity may be that these texts have the same 
structure in both versions: Text 3 has bottom-up structure, and Text 4 
has top-down structure in both original and reordered versions. The first 
paragraphs of Texts 3 and 4 are quoted and discussed below. 
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Text 3 — original coherence, grammatical cohesion 



Because of the high social value attached to humor, 
people like to think that their perception of the comic 
is at least equal to that of others. They rarely admit 
that they do not understand a joke because they do not 
want to feel inferior in a quality that has such value. 
Instead, they pretend to understand it and laugh when 
everyone else does. 

To distinguish between perception of the comic in 
oneself and in others, Gordon Allport has labeled the 
former "a sense of humor 11 and the latter "a sense of the 
comic. ,f The former, therefore, is the ability to perceive 
oneself objectively and to be amused by one ? s inferiorities, 
jealousies and unsocial desires. It is, in short, the 
ability to laugh at oneself. The latter, according to 
Allport, is a "cruder" source of humor in which enjoyment 
is derived from the inferiorities of others — which 
make him feel superior. 



Text 3 — reordered coherence, grammatical cohesion 



It is popularly believed that humor is a mark of 
intellectual superiority. There is no doubt that it is 
closely related to intelligence. Furthermore, much of 
the hunor in jokes and even simple puns depends upon the 
person's comprehension of language — which is closely 
related to intelligence. 

As important as intelligence in the perception of 
the comic is a person's personality pattern. It is 
difficult to perceive humor in anything when one is 
worried or angry, for example. This means that 3uch a 
person often has too many conflicts and anxieties to be 
able to enjoy t) ->mic elements of a situation. Mood 
and emotional tion are central to his reaction. 

This is especial i) in adolescence when, characteristically, 
a person is so se -ye to the opinions of others that 
he would hardly want to appear in a position of 
ridicule. 
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Both original and reordered versions of Text 3 are bottom-up. The 
general statements that begin each of the versions are not the main idea 
of the text. They are different secondary ideas. This structure is also 
evidenced by the fact that the sentences in the original first paragraph 
are not those which begin the reordered paragraph. These secondary ideas 
are amplified and exemplified in the first paragraph only. In the second 
paragraph, a new secondary idea is presented (see Table 7). In fact, the 
main idea is not explicitly stated in any single sentence in Text 3. The 
text presents a series of situations and examples containing different 
aspects of humor. There is a central theme but no single idea. 

Oh the other hand, both original and reordered versions of Text 4 are 
top-down: 

Text 4 — original coherence, lexical cohesion 



All over the world, money and prestige go together. 
The more funds a person has, the more successful the 
person is judged to be* When living on an inherited 
income, whether the money supplements a salary or makes 
work unnecessary, the person is judged as coming from a 
successful family. ,! 0ld money" is thus a symbol of 
family prosperity; by contrast, n new money," or money 
earned by ohe person himself, is regarded as a symbol 
of personal achievement. In every culture, greater 
pfc&ige is associated with old money than with new, and 
the person with old money is more favorably judged. 
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ffcney contributes to two important ends: independence 
and social status. The more funds a person has, the 
more successful the person is judged to be. Since one 
of the bases for social judgment is the amount of money 
the individual has for status symbols and recreations, 
the more wealth a person has, other things being equal, 
the more favorably he will be judged by members of the 
group with which he is identified and th3 greater will 
be the chances of social acceptance and happiness. The 
success of an artist, for example, may be measured by 
the amount of work produced, and a scientists career 
may be measured in the same way; but a musician's or a 
housewife's occupation may not be measured directly by 
the amount of work produced. Nevertheless, everyone 
uses money, and in general, greater means are required 
with each passing year. 



Whereas the same idea (which is the main idea of the text) appears 
in both first paragraphs, the sentences through which the ideas are 
expressed, and the amplifications and exemplifications, are for the most 
part different. Oily sentence 2 appears in both versions above. Moreover, 
three of the five sentences in the seventh paragraph of the reordered 
version are the same as the first paragraph of the original version: 

Text *l — reordered coherence, lexical cohesion (seventh paragraph) 

Although the acquisition of money through inheritance 
is often disapproved, many people associate riches — 
however acquired — not only with social status, but 
also with happiness and security. When living on an 
inherited income, whether the money supplements a salary 
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or makes work unnecessary, the person is judged as coming 
from a successful family* n 01d money" is thus a symbol 
of personal success: by contrast, "new money," or money 
earned by the person himself, is regarded as a symbol 
of personal achievement. In every culture, greater 
prestige is associated with old money tha i with new, and 
the person with old money is more favorably judged. How 
much money a person needs to symbolize his success will 
vary, depending on age and group identification. 



This last par^raph is bottoto-up. It contains proportionately more examples 
and amplification sentences than main idea. Its content is a restatement 
of the main idea, however; thus the structure of the text is circular. The 
same can be said for the original version: the ninth paragraph restates 
the first main idea (see Table 8): 



Text M — original coherence, lexical cohesion (ninth paragraph) 



Since one of the bases for social judgment is the 
amount of money the individual has for status symbols 
and recreations, the more wealth a person has, other 
things being equal, the more favorably he will be judged 
by members of the group with which he is identified, and 
the greater will be the chances of social acceptance and 
happiness. 

The main idea is restated in several sentences throughout the text, 
unlike Text 3 where there was no explicit statement of the main idea. 
Basically, Text 4 has one main idea which is repeated with different 
examples and is therefore recognized fairly easily. 

In both Texts 3 and 4, reordering did not significantly affect the 
Easiness Indices of the accompanying questions. Part of the reason for 
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this was probably the fact that in Text 3 there was no change in focus 
(see above 3. a., pp. 142-145). For Text 4, on the other hand, the main 
idea was restated so often that it was obvious to the students. Although 
the text was not easy, whatever difficulties the students may have had in 
comprehending it, finding the main idea was probably not one of those 
• difficulties. 

C. SUMMARY AND CONCLUSION 

The research question dealing with coherence was whether the 
reorganization of information in a text would affect reading comprehension 
for our EFL students. The sentences in six texts were reordered so that 
the texts still made sense but were structured differently. The difficulty 
of each of the text versions was measured by the Flesch Reading Ease 
Readability Formula, rational cloze procedure, and M-C Tests. T-tests and 
F-lest3 were applied to the Easiness Indices of test questions. 

After finding that the reordered versions of four of the six texts 
were more difficult than the original, the researcher examined the possible 
reasons for these differences. Of the five aspects of discourse examined, 
top-down/bottom-up structure appeared most likely to have affected the 
reordering process. First paragraphs of the four texts where the original 
version was significantly easier showed top-down structure in the original 
version and bottom-up structure in the reordered version. 
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The effect of discourse patterns (i.e., additive vs. contrastive 
paragraphs) was less clear. Although the contrastive paragraphs were more 
difficult, there were only five more of them in the reordered than in the 
original versions. This proportion is hardly enough to account for the 
difference between the two. test versions. 

Cohesion, a factor we carefully doctored into the texts, apparently 
had no significant effect on the reordering process. And yet, it is clear 
that when sentences were reordered, cohesive ties were changed. Part of 
the reason for lack of statistical effect may have been the overlapping 
and contradictory effects of each of the features of cohesion separately, 
resulting in a blending of opposing focuses and a non-differentiated general 
picture. 

In all o r these conclusions, it must be kept in mind that our main 
instrument, the Easiness Indices of M-C questions accompanying doctored 
sections of text, may not have been fine enough to be attuned to any but 
the most obvious textual differences. The difference that we did find 
between original and reordered versions was not caused by any single factor, 
but probably by a combination of these three factors selected for examination: 
top-level structure, illocutionary force, and cohesion. 
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1. Note that for Teat 1 the t-test was not significant* and for Test 2 
the F-test was not significant. 

2. Uhfortunately, none of the texts examined original bbttom-up structure 
and reordered top-down structure • Top-down structure is apparently more 
common* A replication of this study, however, should also include at least 
one text vliose original discourse structure is bottom-up and Whose reordered 
structure is top-down. 
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COHESION 

A. A CAUSE OF DIFFICULTY IN READING COMPREHENSION 
1 • Text Cohesion and the Reading Process 

In this study, the term w oohesion n refers to both grammatical anaphoric 
cohesion and lexical cohesion. Following a selected portion of the taxonomy 
of Halliday and Hasan (1976), we included these features of grammatical 
cohesion: pronouns (personal, demonstrative, and their repetition), 
substitution (nominal, verbal, and clausal), ellipsis, and exophoric 
reference; and these features of lexical cohesion: general words, 
superordinates, synonyms, and repetition, Tha nuraber~of items within a 
text of each of these features was increased to a maximum amount by the 
doctoring process in order to research the phenomenon of cohesion. 

The classification of Halliday and Hasan (1976) contains grammatical 
reference, substitution, ellipsis, conjunctions, and lexical cohesion. 
Thus there is an implied distinction between grammatical and lexical 
cohesion. The present study is concerned with lexical cohesion and with 
granmatical reference, and ellipsis, excluding conjunctions. Conjunctions 
were excluded because we saw them as dealing with the element of logical 
relations — an area separate from the substitution of one word for another 
word, phr; or clause, and beyond the scope of the present study. , 



FIVE 



Although Halliday and Hasan (1976) explain that there is n hard- 
and-fast separation between grammatical and lexical cohesion, for the 
purposes of this study texts were doctored separately and contained 
predominantly items of either one type of cohesion or the other. To obtain 
a representative sample of items of each feature, we included as many items 
as possible in the texts. 

Since we were not certain whether, as a cause of difficulty, cohesion 
was basically one factor or two (grammatical and lexical), we began our 
study with the latter assumption and doctored our texts separately, so 
that both types of cohesion were taken into account. 

A survey of the literature in the areas of recall and reading for 
native and non-native speakers of English indicated that the effect of 
cohesion in the reading process was a complex subject that might be expected 
to cause difficulty: 



I see several reasons for discussing anaphora here 
as an illustration of intersentential devices in reading 
comprehension. First, if a reader cannot handle an 
anaphoric expression as the writer" intended, there is 
no way that he or she can correctly update his or her 
discourse model in response to it. Second, ... choosing 
between possible antecedents may demand ver*y sophisticated 
syntactic, semantic, pragmatic, inferential, and evaluative 
abilities on the reader f s part. ... One might suspect, 
therefore, that anaphora might easily be a source of 
comprehension difficulties. (Webber, 1980, p. 142) 



Items of grammatical cohesion, anaphora, were indeed found to be good 
predictors of difficulty for native English speaking college s&dents 
(Dutka 1978) and to cause difficulty in reading comprehension of weaker 
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students of EFL (Sim 1979) and not-so-fluent native English speakers 
(Marshall and GLook 1978-79). Other researchers, however, found no direct 
connection between anaphora and reading "difficulty for either' students of 
EFL (Baten 1981) or for native English speakers (Meyer 1975, Fishman. 1978). 
It was not clear whether their findings reflected * lack of relation or a 
shortcoming of the measuring devices used to* evaluate this^relation. 
Frederiksen (1981) found that, for native speakers, sentences containing 
reference required more reading tirae.^ Repetition was found to be a factor 

• 4 

making texts easier (Flesch 1950, Kintsch et al. 1975). , 

The present study approached the problem of the relation between 

f 

cohesion and reading difficulty from the point of v*ew of the advanced EFL 
learner. A variety of measuring devices were used: Flesch Readability 
Formula, multiple-choice (M-C) comprehension questions, and modified 
rational cloze procedure, 

2. Original vs. Doctored Texts 

That text cohesion is one of ohe factors affecting reading comprehension 
is reasonably certain. Whether or not the misunderstanding of specific 
features of cohesion in a text is an obstacle so significant as to measuraoly 
hinder comprehension is another matter and is not easily proved. To answer 
this question the doctoring procedure was devv^ >ped because the frequency 
of cohesive items needed to be increased in order to study the phenomenon 
of cohesion. Six texts were edited to include mo/e items of cohesion than 
found in the original versions of those texts. 
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The following hypotheses were proposed: if the orignal texts were 
found easier than the texts doctored for cohesion, then the addition of 
extra markers of cohesion could be considered a factor causing difficulty* 
If the original texts were found to be on the same level of difficulty as 
the doctored texts, then cohesion could still be considered a factor causing 
difficulty but might no > be singled out as a significant factor* If the 
original texts were harder than the doctored, then cohesion could not be 
considere- as a difficulty-causing factor at all* On the, contrary, markers 
of cohesion could then be seen as a factor reducing difficulty. 

Difficulty of text versions wcs f. sured in two ways: by the Flesch 
Reading Ease Readability Formula and by test results of M-C questions 
accompanying the texts. 

3. Findings 

a. Difficulty 

1 ) Flesch Reading Ease Readability Formula 

Results of the Flesch Reading Ease Readability Formula (see Appendix 
C, "Table 1, "Texts Ranked According to Flesch Reading Ease Formula) for 
Texts M show the difficulty level of the original versions to be within 
the same range as that of the versions doctored for both lexical and 
grammatical cohesion. (For the formula itself, see Chapter TWo A. 2., p. 
3.) Separating the feattres of cohesion into the categories of grammatical 
and lexical (see Halliday and Hasan 1976), the researcher found that for 
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Texts 1, 2, and 3 the original versions were more difficult than the 
doctored for lexical cohesion. For Texts 2 and **, the original versions 
were easier than the grammatical, and for Text 1 the original was on the 
same level as the grammatical version. For Text 3> the original was more 
difficult than both doctored versions: for Text 4, it was slightly easier 
than both doctored versions* Thus, judged by this formula, the versions 
doctored for grammatical and lexical cohesion were usually more difficult 
than the original texts, though there appear to be additional factors in 
the texts that affected the issue* 

2) M-C Tests 

Results of Tests 2-4, each accompanied by twenty M-C questions, 
differed from the Flesch Readability Formula, In general, the original 
version was found to be on the same level of difficulty as the doctored 
versions (see Appendix C, Table 15, "Results of M-C Comprehension Tests 
1-4 ~ Cohesion," and Tables 27-32, "Easiness Indices"). These findings 
were based on results of t-tests and F-tests (ANOVA) where test scores 
were compared according to type of cohesion and text. It Must be remembered 
that the M-C questions themselves can be easy or difficult to read, and 
they may not necessarily be at the same level of difficulty as the text 
(see Bensoussan 1982). This thesis is based on the results of M-C questions. 
When exaniniug the results, we must keep in mind that the questions measure 
text difficulty only indirectly. For a distribution of features of cohesion 
tested by each question, see Appendix C, Tables 20-25, "Matching Test 
(toestions With Lexical and Grammatical Items of Cohesion in the Text." 
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3) Conclusions 

The conclusion would be that although grammatical and/or lexical 
cohesion may not be greater obstacles to comprehension than other given 
elements in a text, they nevertheless contribute to reading difficulty. 
Ch the Whole, the results based on grammatical and lexical cohesion could 
be said to be similar despite the fact that the Flesch Reading Ease Formula, 
was based on the texts alone, whereas M-C tests used information from 
questions accompanying the texts. There was no clear-cut indication from 
either of the two methods that the original version could be considered 
as consistently differing in difficulty from the doctored versions. 
Conversely, for the most part, the doctored versions wc e at least as 
difficult as the original. 

b. Length 

For five of the six texts, the grammatical versions had the fewest 
nunber of words — from a minimum of 20 words fewer (Text 1) to a maximum 
of 85 words fewer (Text 5). In Text 4 the grammatical and lexical versions 
were of nearly the same length (see Appendix C, Tables 2 and 3> "Items of 
Grammatical and Lexical Cohesion in Original and Reordered Texts"). Thus 
the shorter, grammatical version, having the same content, was denser and 
more concentrated than the other versions. It was expected that this 
condensation of text would cause the grammatical version to be more 
difficult. This did not appear to be the case, however. 
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For five of the six texts the grammatical versions were harder than 
the lexical. According to the Flesch Formula (See Table 1), for Text 3 
the lexical version was slightly more difficult. Ihat is, the variety in 
vopabulary Increased text difficulty. Although the lexical versions were 
% generally longer, containing a greater number of words, the increased 
length of text did not appear to make the lexical versions more difficult 
than the grammatical versions. 

In the four texts where the original version was analyzed, it was 
closer in length to the lexical version than to the grammatical for two 
of the texts (Texts 1 and 3) and closer to the grammatical version for 
Text 2. For every text the original version had a greater number of words 
than the grammatical version. Thus the grammatical version was also shorter 
and more concentrated than the original version. 

Length of text did not appear to affect difficulty significantly, 
however. F-test (ANOVA) results of M~C test scores showed no significant 
differences between the longer lexical versions and the shorter grammatical 
ones. (See below B. 1.b.2), M-C Tests , pp. 175-177, and Appendix C, Table 
18, "Results of M-C Questions on Texts Doctored for Grammatical and Lexical 
Cohesion. n ) Hence any .assumptions either that the shortest or the longest 
texts v*>uld be the most difficult were unfounded. No connection was found 
between length of text and difficulty. 

This finding makes sense if one views a text or discourse as a series 
of propositions, not of words. In that case, the doctoring procedure 
affected only the wording of the propositions but not their number, their 
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content, or the context of the propositions relative to each other. 
Therefore, the texts were not basically changed* If comprehension depends 
to a certain extent on the reader f s deriving macro-structures from 
micro-structures (van Dijk 1978, 1980), then the actual wording of the 
micro-structjres may be secondary to ohe concepts or propositions themselves/ 
Kintsch and Vi pond (1977), Fishman (1978), and Baten (1981) have also found 
that it is the nunber of propositions, not words, that affects the reading 
process • 

B # GRAMMVHCAL VS. LEXICAL COHESION 

1 • The Doctoring Procedure 

a. Con?* raints on Test Development 

The findings of this thesis depend largely on the doctoring procedure. 
For this reason it was carried out with great care and its word corpus 
minutely examined. Items of cohesion were inserted according to the 
taxonomy of Halliday and Hasan ( 1 976) • Since the texts were used as actual 
mid-year and final examinations, they could not be distorted as a result 
of the doctoring procedure, 1 To keep the texts sounding natural, we could 
not insert too many items of cohesion. In fact, the proportion of cohesive 
items in the texts was surprisingly small. In the original versions of 
Texts 2-4, 3% - 4JS of the total number of words were items of grammatical 
cohesion, and 6% - 8% were items of lexical cohesion (see Appendix C, 
Tables 2 and 3). In the doctored versions of Texts 1-6, the percent of 
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items was not 30 much higher: 4$ - 12> grammatical, items i»< the grammatical 
versions, 5% - 12J lexical items in the lexical versions. Because of the 
necessity of keeping the prose as natural as possible, it was not always 
possible to insert as many items (or, as many examples of items) of each 
feature as would have been desirable in order to obtain statistically 
significant results. Thus the range of the item sample was restricted by 
the fVanework of the experiment, and this restriction, no-doubt, affected 
the results. 

Furthermore, each version was not purely- either grammatical or lexical; 
it did not contain only those items to be tested. It was not possible to 
completely eliminate grammatical items from the lexical version, and vice 
versa. In Texts 1-6, the grammatical version contained as many as 2% - 
1% itemr of lexical cohesion although the lexical version contained only 
up to 1% grammatical items. By increasing the frequency of the cohesive 
items, we had hoped to create texts that would indicate general, if not 
clear-cut, tendencies. However, the most important procedure was to keep 
the texts sounding natural, similar to the te^ts students would ordinarily 
be reading. 

Another difficulty was categorization of the cohesive items according 
to Halliday and Hasan (1976). Sometimes a word might be thought to function 
in more than one way, and decisions were made confining words to specific 
categories. This was in fact a very difficult task. Since the number of 
cohesive items was relatively small, discrepancies in categorization could 
affect test results. Tables 20-25 (Appendix C) list the questions and 
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the corresponding items of cohesion in the text. If categories overlap, 
double-counting occurs whereby an item is counted as pertaining to more 
than one feature. Including such items in a category may inflate it 
artificially and make it less valid than if categories were mutually 
exclusive. Yet words sometimes do have more than one function simultaneously, 
and the categories are not hard-and-fast entities* For these reasons the 
task of categorization was a dificult one* 

b. Findings 

1) Flesch Reading Ease Readability Formula 

For Tests 1-6, che Flesch Reading Ease Readability Formula was applied 
to the first 100 words. Results showed the grammatical versions to be 
more difficult than the lexical versions (chi-square test for goodness of 
fit: chi-square = 6.75, df=1, p<.01). 

2) H-C Tests 

There was a total of 120 questions (six texts, each with twenty M- C 
questions). For M-C Tests 1-6, t- tests and F-tests (ANOVA) were applied 
to test scores (see Appendix C, Table 13, "Results of M-C Questions on 
Texts Doctored for Grammaical and Lexical Cohesion," and Table 27, "M-C 
Questions With Significant Differences"). Ho significant differences 
between grammatical and lexical versions were found, except in one year 
(1978). Usually the grammatical versions were harder, but not significantly 
so* 
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Applying t-tests to the separate questions according to version (e.g., 
the results of Question 1 in the lexical and grammatical versions), it was 
found that for 25 questions (^1%) of the total 120 questions there wa a 
significant difference between grammatical and lexical text versions (see 
Table 18). The number of questions was relatively small, however, and 
there does not seem to be any reason for* those particular questions to be 
significantly different. 

According to the results of F-tests, 18 (72%) of the 25 questions 
were more difficult in the grammatical version, 6 (24%) of these questions 
were harder in the lexical version, and 1 question (4%) had the same mean 
Easiness Index in both versions. T-tests were also applied to all 120 M-C 
questions. There were fewer significantly different questions between 
grammatical and lexical versions found by the t-tests than were found by 
the F-tests: 7 questions out of the total 120, all of which were more 
difficult in the grammatical version. Only 2 (8%) of the 25 questions 
that were found significant in F-tests, however, were the same ones that 
were found significant in the t-cests. Moreover, the percent of significant 
questions out of the total was relatively small (F-»tests: 25 out of 120 s 
21 %, 18 more difficult grammatical ou^ of 120 = 15%; t-tests: 7 more 
difficult grammatical out of 120 = 6% of the total question?^. 

Although the general direction of the Easiness Indices of the M-C 
questions, from both F-tests and t-tests, indicates that the grammatical 
versions were more difficult than the lexical versions, nevertheless, these 
results were not indicated in the total test results. It may be concluded 
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that these particular questions were significantly different by chance. 
Alternatively, it may also be concluded that although there was a general 
tendency for the grammatical versions to be more difficult, this tendency 
was so slight that it did not affect overall test results. 

2. Hierarchy of Features of Cohesion 

a. Categorization of Questions According to Features 
of Cohesion 

Each of the twenty questions accompanying each of the six tests was 
categorized according to the features of cohesion included in the text 
(Halliday and Hasan 1976). Ihe reader would supposedly need to comprehend 
these items of cohesion in the text in order to answer the questions. The 
weighted mean was calculated for each feature separately. Mid-year Tests 
1-4 were examined separately from the more difficult Final Tests 5 and 6 
(see Appendix C, Table 1U, "Hierarchy of Easiness Indices of Questions 
related to sections of text containing cohesive items (Texts 1~ , l) n ). No 
hierarchy of difficulty was found to exist. In fact, if anything, the 
mid-year exan questions had an inverse relation to the final exam questions. 
Correlations between sets of items in Tests 1-4 and Tests 5-6 were negative: 
r (grammatical) = -.34, r (lexical) r -.69, and r (both grammatical and 
lexical together) = -.36. 

Moreover, no feature consistently indicated difficulty by having a 
low Easiness Index for all the texts. A question including text that 
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contained a lexical cohesive marker that was a general word t for example, 
was not necessarily either easier or more difficult than a question relating 
to a section of text which contained any other items of cohesion. In Tests 
1-4, questions relating to general words were of the same difficulty level 
as lexical repetition and synonyms, and grammatical extra-textual cohesion, 
nominal substitution, demonstratives, and reference. In Tests 5 and 6, , 
questions containing general words were on the same level as lexical 
superordinates and grammatical extra-textual cohesion, reference, and 
clausal substitution. These y were all items of average difficulty. 

On the other hand, items that had very low Easiness* Indices for one 
set of texts were not so difficult for the other set* In Tests 1-4, 
questions containing verbal (e.g., do, have ) and clausal /e.g., so, not ) 
substitution were most difficult. In Tests 5 and 6, however, verbal 
substitution ranked next to easiest and clausal substitution was of average 
difficulty. Likewise, nominal substitution (e.g., one , some , few ), which 
was most difficult in Tesi;s 5 and 6, was found to be next to easiest in 
Tests 1-4. 

Of all the features, clausal substitution was most consistently found 
in the group of difficult features. It .^akes sense th^ when a single word 
(e.g., so, not ) stands for an entire clause, it would cause the reader 
some effort to find the clause and place it in the new context. This 
process would probably be more Remanding of the reader tha:< simply matching 
a pronoun and its one-word nominal referent. 
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These results involve differences in text (and/or test) difficulty 
as well as in student proficiency level* Tests 1-4 were mid-year exams, 
administered after fifty hours of instruction (mean scores: 63% - 66%); 
Tests 5-6 were final exams t administered after 100 hours of instruction 
(mean score: 53%). For one of the five testing years, 1980, the same 
students took all six tests (see Appendix C t Table 18, "Results of M-C 
Qiestions on Texts Doctored for Grammatical and Lexical Cohesion") • 

b. Repetition and Difficulty 

Though it is difficult to generalizev one can say that section 1 of a 
text containing either lexical or grammatical repetition were easier to 
read than other parts of the text. Rather than causing an obstacle to 
reading (e.g., the cohesive, item it repeated through two or more sentences 
in a cohesive chain and possibly causing confusion), repetition actually 
seemed to aid the students, Tnis finuing confirms work by Flesch (1950), 
Sim 0 979)» Pensoussan (1980),' and Baten (1981). 

Lexical repetition involves the repetition of the original word in 
the text. Grammatical repetition is the cohesive chain formed by the 
original v*>rd, its referent (e.g., ijt), and the repetition (at least once) 
of that referent (see Appendix C, Tables 11-13» "Cbhesive Chains"). According 
to Table 14, Appendix C, "Hierarchy of Easiness Indices," repetition wa3 
the easiest feature in Tests 5 and 6 (61%) and was also relatively easy 
in Tests 1-4 (61*). Lexical repetition, also second highest in Tests UM 
(66*), appeared much more problematic in Tests 5-6 (52%). Since there was 
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overlapping (i.e,, the same section of text containing more than one feature 
of cohesion), it is not clear Whether this low mean was the result of 
lexical repetition alcne or additional, intervening factors. The fact 
that this figure was based on as many as 141 questions suggests the latter 
possibility — that the sections of text" on which the questions were based 
contained features other than lexical repetition. As a general trend, 
then, mean Easiness Indices of questions on texts containing lexical and 
grammatical items of repetition were relatively high. There was no special 
difficulty in those questions. 

Repetition may have the opposite effect from that of text condensation 
(see below C. COHESION , pp. 182-183). Repetition of a word or idea may 
serve as reinforcement and therefore make the text easier to read. 

c Cohesion: A Single Continuum of Difficulty 

Viewing cohesion as a semantic relation which is realized through the 
lexicogrammatical system, Halliday and Hasan (1976) state: 

The distinction between grammatical and lexical is only 
one of degree Some forms of cohesion are realized 
through the gr<mar and others through the vocabulary, 
(p. 6) 

The categories of Holiday and Hasan (1976) which are relevant to the 
present study are reference, substitution, ellipsis, and lexical cohesion. 
For the purposes of this s2udy, we decided to separate these two types of 
cohesion even more sharply than do HalRday and Hasan (1976) and to include 
reference, substitution, and ellipsis in the single category of grammatical 
cohesion. 
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The results Indicate that the effect of a cohesive Item appears to 
depend on the text and the reader, but not on the type of cohesion. 
Statistically, there did not appear to be two separate and distinct types 
of cohesion, but rather a single continuum cf twelve features whose 
difficulty levels varied according to the texts. Repetition appeared to 
make reading easier, whether It was repetition of nouns (lexical) or 
pronouns (grammatical). 

Although in terms of descriptive grammar it may be justifiable to 
separate cohesion into lexical and grammatical categories, nevertheless 
on the practical level, there seeded to be no difference in the way they 
affected reading difficulty. For our purposes, it did not seem to matter 
whether the features were grammatical or lexical. They appeared to hinder 
reading comprehension to approximately the same extent. 

3. Crossing of Test Results; Ease and Difficulty 

In this study, features of cohesion as causes of reading difficulty 
have been researched. In 'many cases, separate isolated items caused reading 
dlffculty. Yet the repetitxon feature of cohesion, in both lexical and 
grammatical versions, was not found to be a hindrance. Thus the positive 
effect of repetition could cancel out some of the negative effects of other 
features of cohesion. 
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C. COHESION: THE PROBLEM FOR EFL READERS 

Items of grammatical and lexical cohesion present two different kinds 
of reading problems. Grammatical cohesion shortens a text without reducing 
the number of propositions. The resulting condensation may in itself be 
t a factor causing difficulty. Individual items of ellipsis and nominal, 
verbal, and clausal substitution that mark the place of nouns, verbs, and 
clauses must be recognized as such by the reader. But there are no semantic 
clues in these words: they are simply place markers. Hence readers may 
be confused about what a particular item may stand for in a text. For 
example, if the vord "such," two sentences above in this text, is misconstrued 
as referring to "nouns, verbs, and clauses" instead of "individual items 
of ellipsis and ... substitution," the reader will be confused. 

Items of lexical cohesion present another kind of difficulty. Except 
for repetition, where the reader readily recognizes the marker of cohesion, 
synonyms and superordinates must be seen "as identifying the same referent 
as the original word in the text. This process can be carried out only 
if the reader understands the meaning of the words — something that cannot 
be taken for granted with our EFL students. Furthermore, general words 
such as "process" and "something" (as in the previous sentence of this 
text) carry almost as little semantic meaning as items of grammatical 
cohesion. For items of lexical cohesion, then, readers have a double 
problem: recognizing the relation between the words and understanding their 
meanings. 
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Items of cohesion mark relations between words: their purpose is to 
facilitate reading. For native speakers Who are fluent readers, and who 
may not even need markers of cohesion, they probably do. Most of our EFL 
students, however, may be similar to the not-so-fluent native readers 
t (Marshall and Clock 1978-79) who cannot infer information and therefore 4 
need the help of markers of cohesion (see Chapter TWo, C.2.b.1)a)2), 
Concentration of Information , pp> 60*62). If they are not able to decipher 
the markers of cohesion, however, readers cannot use .them as aids or signals 
in the text. As a result, rather than facilitating discourse processing, 
for those not-so-fluent readers who cannot understand them, markers of 
cohesion may actually hinder comprehension. 

The problem is identical for both markers of grammatical and lexical 
cohesion. If the reader misses the relation between certain words, whether 
they are a noun and its pronoun or a noun and its superordinate, the meaning 
of at least part of the text is lost. 

Although this problem can arise either within a single sentence (or 
proposition) or be 'een sentences (or propositions) and even paragraphs % 
it is basically a , cro-level problem. That is, readers are required to 
see the relations among words in the discourse. In most prose passages, 
the problem rarely arises on the macro-level of comprehension (i.e., 
paragraph level, illocutionary force). Usually, on the macro-level, other 
contextual clues intervene to reinforce the marker of cohesion. When the 
item of cohesion spans the paragraph level without the help of redundancy, 
however, lack of comprehension of the cohesive marker would also be expected 
to affect macro-level comprehension. 
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D. SUMMARY AND CONCLUSION 

The present study approached the problem of the relation between 
cohesion and reading difficulty from the point of view of the advanced EFL 
learner. A distinction was made between lexical and grammatical cohesion, 
and texts were doctored separately to contain predominantly items of either 
one type of cohesion or the other. Following "the taxonomy of Halliday and 
Hasan (1976), grammatical cohesion included pronouns, substitution, ellipsis, 
and exophoric reference. Lexical cohesion included general words, 
superordinates, synonyms, and repetition. Original texts were compared 
with those doctored for cohesion; lexical and grammatical doctored texts 
were compared with each other. 

Text difficulty for six texts was evaluated by the Flesch Reading 
Ease Readability Formula and the Easiness Indices of M-C questions on the 
texts. There was no clear-cut indication that the original version could 
be considered consistently differing in difficulty from the doctored 
versions. Conversely, for the most part, the doctored versions were at 
least as difficult as the original. Results were similar for grammatical 
and lexical text versions. It was concluded that although grammatical 
and/or lexical cohesion may not be greater obstacles to comprehension than 
other given elements in a text, they nevertheless contributed to reading 
difficulty. 
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NOTES TO CHAPTER FIVE 



1. I am grateful to the teachers of the Department of Foreign Languages, 
Haifa University, for their help in editing the texts to make them sound 
more natural. (See Notes on Chapter Three, Note 3.) 

2. Words were categorized in consultation with Prof. E.A. Levenston, 
Department of English, The Hebrew University of Jerusalem. Nevertheless, 
categories are not hard-and-fast, and some decisions were difficult to 
make (see above, Chapter TWo, B.3.f.? Boundaries between Grammatical and 
Lexical Cohesion , pp. 48-49). 
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CHAPTER SIX 
SUMMARY AND CONCLUSIONS 

A. Summary of Findings 

Taking into accouit both reader and text, this investigation of causes 
of reading difficulty addressed itself to two factors in the reading 
process: the reader's ability to understand sequences of propositions 
(i.e., coherence) and his/her familiarity with markers of cohesion. 
Inadequacy in either of these two areas was expected to hinder the reading 
comprehension of students of EFL (English as a Foreign Language). 

Text was defined as a realization of the meaning of a discourse. A 
given text, then, would be one alternative version of £ possible versions 
of that particular discourse. The six texts in the investigation were 
analyzed on the micro-level (i.e., word and sentence) and the macro- level 
(i.e., paragraph and whole-text). Both the surface meaning of utterances 
(i.e., propositional content and paragraph level concepts) and the intention 
of the utterances (i.e.,, sentence function and illocutionary force) were 
examined as possible causes of difficulty. 

The factor of reading difficulty was quantified and operationally 
defined in terms of scores on M-C comprehension tests and rational cloze 
tests. These findings were compared with results of the Flesch Reading 
Ease Readability. Formula and oral interviews with fifteen of the students 
who had taken the M-C tests. 
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It was assumed that coherence and cohesion were two causes of reading 
difficulty for advanced Israeli students of EFL. In order to test the 
effect of coherence and cohesion, six texts were doctored by including 
markers of grammatical or lexical cohesion and by reordering the sentences 
in the texts. This study examined the difference in difficulty levels of 
the alternative text versions. 

1. Coherence 

The sequencing of information, that aspect of coherence on which thij 
study focused, was indeed found to be a factor causing reading difficulty. 
The order in which information appeared in a text seemed to make a difference 
in the students 1 ability to comprehend it. Thus the first research question 
(see Chapter One, D. Research Questions , pp. 13-1*0 was answered in the 
affirmative. 

Operating on the macro-level * coherence deals with th* purpose and 
intention of the text — the impression it makes on the reader. On the 
proposi tional level, the text focuses on certain aspects of a given 
situation. It is the reader's task to comprehend an argument by understanding 
not only each separate proposition, but also how it is linked to the ones 
preceding and following it. These links may be overt, signalled by cohesive 
markers, or covert, implied rather than explicitly stated. 

Psycholinguists have called the reader's ability to process information 

* 

by integrating propositions into larger units "chunking" (see Miller 1956, 
Smith 1978, Kieras 1978). Using different terminology for the same 
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phenomenon, van Dijk (1977b, 1980) explains that readers derive macro- 
structures, or meaning on the global level, from micro-structures, or 
propositions on the local level. 

For students of EFL, however, the ease with which integration occurs 
appears to depend to a certain extent on the sequence in v*iich the information 
or propositions are presented. Some versions of text were found to be 
significantly easier than others if the sentences were sequenced in one 
order as opposed to another. 

Several factors were found to contribute to differences in the effects 
of sequencing: additive vs. contrastive paragraph structure and top- down 
(i.e., main idea first) vs. bottom-up structure (i.e., beginning with 
secondary ideas and leading up to the main point). Greater difficulty was 
found to result from oontrastive and bottom-up paragraphs than fVom additive 
and top-down paragraphs. The most difficult type of text, therefore, would 
be one beginning with secondary ideas or examples, followed by contrasting 
ideas or qualifications and their examples, before finally leading up to 
the main idea of the text. The easiest paragraph structure, then, would 
be a text beginning .with the main idea followed by amplification (e.g., 
explanation or examples). 

A thi^d factor affecting the coherence of a text was the appearance 
of explicit, overt markers of cohesion. Their function and/or the ideas 
they linked sometimes changed with the reordering of information. Cohesion 
was therefore considered to interact with coherence in the reordering of 
information. 
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2. Cohesion 

a. Grammatical vs. Lexical 

Cohesion, defined in this study in terms of grammatical cohesion 
(anaphora and cataphora) , substitution, and ellipsis, and lexical cohesion 
(general word, synonyn;, superordinate, and repetition), appeared to affect 
textual coherence. As a separate, single factor, however, cohesion did 
not appear to affect reading difficulty. This finding ran contrary to the 
expectations of the researcher who expected to find that either grammatical 
or lexical markers of cohesion, or both, would significantly affect text 
difficulty. One of the reasons for this expectation was the manner in 
which the two types of cohesion affected text length. The grammatical 
text versions were generally shorter than the lexical ones since the 
grammatical markers of cohesion such as j^t, this , or so used one word in 
place of a clause or sentence, or else, as in the case of ellipsis, were 
eliminated altogether. Thus the grammatical versions were more condensed 
than the lexical. One of the reader's tasks was to locate, trace, and 
reconstruct the antecedents of items of grammatical cohesion. 

Another reason for expecting cohesion to affect difficulty was the 
wide lexical knowledge demanded of readers by lexical markers of cohesion. 
Readers nsed to recognize that synonyms, superordinates, and/or general 
words are equivalent to certain lexical antecedents in the text. In 
addition to being able to trace these markers, readers must also know their 
semantic meanings. The problem cf vocabulary is thereby added to the 
problem of having to link propositions. 
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Theoretically, markers of cohesion should help students find their 
way through a text by indicating the links between propositions. It was 
assumed that readers who are unable to understand these markers cannot use 
them as signposts to navigate through the texts. Moreover, rather than 
serving as helpful clues, cohesive markers are assumed to be either ignored 
by the weaker readers, or worse, to become stumbling blocks which hinder 
progress through the text. 

No statistical evidence, however, was found to support the claim that 
markers of grammatical or lexical cohesion specifically caused reading 
difficulty. It also appeared that grammatical and lexical cohesion were 
of relatively equal difficulty for advanced students of EFL. 



Finding no significant differences between grammatical and lexical 
cohesion, the researcher examined each feature separately. Repetition of 
both lexical and grammatical items (i.e., nouns and pronouns) was the only 
feature that did not appear to contribute to reading difficulty. The other 
features (e.g., substitution, ellipsis, general words) contributed 
occasionally, but without any discernible pattern, depending on the context. 
It was not possible, however, to arrive at a hierarchy of difficulty for 
features of cohesion. 

The question was then raised as to whether there is a practical 
dichotomy between grammatical and lexical cohesion. As Halliday and Hasan 
( 1 976 > pointed out, the classification is not always easy to make, as there 
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is some overlapping between the two categories. In terms of reading 
difficulty, this study found no differences among features of grammatical 
and lexical cohesion. 

« 

B. LIMITATIONS 

1. Texts 

a. Classification System 

The system of classification designed by Halliday and Hasan 0976), 
distinguishing between lexical and grammatical cohesion, does not present 
a clear delineation. Cohesion being a semantic relation, 

there is no hard-and-fast division between vocabulary 
and grammar; the guiding principle in language is that 
the more general meanings are expressed though the 
grammar, and the mere specific meanings through the 
vocabulary, (p. 5) 

The classification, then, and its labelling are some'that misleading 

because "grammatical" is not meant to exclude the semantic component found 

in "lexical." But neither can the notion of lexical cohesion wholly exclude 

the grammatical. 

Within this system, there are eight subgroups of grammatical cohesion 
and four subgroups of lexical cohesion. This classification system was 
meant to be descriptive and was not originally intended to relate to reading 
difficulty. It seems plausible, then, within the eight subgroups of 
grammatical cohesion, and/or the four of lexical cohesion, that some would 
cause difficulty in reading, whereas others might actually aid comprehension. 

smc , . . . .200 . 
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That is, the emphasis on two distinct kinds of cohesion, lexical and 
grammatical, may be misleading . Rather, each of the twelve subgroups of 
cohesion may affect reading comprehension independently* Further research 
may be carried out beginning from the starting point of twelve subgroup* 
of cohesion rather than two* 

b. The Doctoring Procedure 

Since these experiments were actually used as achievement tests at 
the end of each semester, our first priority was for the texts to sound 
as natural as possible. Bearing this criterion in n>ind, we were not always 
able to write in enough items of cohesion so that each feature of cohesion 
would be adequately presented. The net result may' have been that the less 
frequent features of cohesion were virtually ignored on the statistical 
level • 

Oh the other hand, given the fact that the original undoctored texts 
are a mixture of grammatical and lexical cohesion, the effect of doctoring 
would be to produce a somevJhat "unnatural" text. In the doctoring procedure, 
the equivalent amount of "unnaturalness" in both grammatical and lexical 
versions may have been produced, thus cancelling any special effect. 1 

Furthermore, isolating the features absolutely so that there would 
be only grammatical items in the grammatical text version, for example, 
was almost impossible* There was some overlapping of lexical items in the 
grammatical version, and vice versa. At most, moreover, cohesive items 
made up only 12% of the total number of words in any taxt version. This 
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ratio may have been insufficient to show statistically significant 
differences* 

Finally, in any given text there is so much redundancy in the use of 
• cohesive markers thaat it may not matter if the reader cannot identify 
tham all (Weaver 1962, Hatch 1979). 

C: Subject Hatter 

The subject matter of the texts may not have appealed to the teachers 
choosing the texts and/or to the students taking them, in the first 
instance, teachers gave certain texts to fewer students. In the second, 
lowered student motivation may have been reflected in disproportionately 
lower test scores than students' English proficiency level Would have 
warranted* 

d. Discourse Patterns: Sentence Function , 
Illocutionary Force, and Paragraph-Level 
Concepts 

Application of these terms to any particular text is a subjective 
exercise since they do not lend themselves readily to qualitative examination. 
Decisions on classification made by the researcher might have been made 
differently by other* in the field. It is also true, however, that this 
understanding of sentences and their functions on different levels of 
meaning is an inevitable feature of comprehension. Thus Cicourel (1980) 
states: ^ 
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The fact that a particular utterance can be classified 
as conveying different speech acts and multiple messages 
gives this type of analysis the flavor of an expansion 
that goes beyond the data given. This expansion is a 
built-in feature of the interpretation that parses and 
classifies utterances into speech act categories, (p. 
110) 

Accepting the fact that some items could be classified as exemplifying 
more than one feature, the researcher included as wido a range of features 
as was logically possible in the classification of the texts. 

2. Tests 

a. Multiple-Choice (M-C) Te3ts 

To a large extent, the success of the research depended on the quality 
of the M-C questions. Unfortunately, a few questions had to be accepted 
with low Discrimination Indices (point-bi serial correlations between the 
student response and the total raw test scores that were below *30) Pre- 
testing was not always possible, and even when questions were re-worded 
on the basis of item analysis results of the previous year, the new questions 
were not always much more successful than the old. Except for these few 
questions, however, the tests were generally satisfactory. Moreover, 
although M-C tests are only an indirect measure of text difficulty, this 
is a dravtoack they share with most other kinds of tests. Hence other test 
types were used to measure text difficulty as well (see below, C. 3.* 
Testing and Research , pp. 202-203)* 
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b. Number of Direct Multiple-Choice Questions 

Although every effort w*u< made to ask at least ona question for each 
section of text that was doctored (i.e., contained items of grammatical 
or lexical cohesion), it sometimes happened that this was impossible. 
Either the nature of the text or the overlapping of questions made it 
necessary to ask whole-text level or word-level questions in place of the 
desired sentence-level or paragraph-level questions. Ehough specific 
questions were asked, however, to provide result5 indicating general 
trends. 

c. Double-Counting 

In some cases, one question covered a section of text containing more 
than one feature of cohesion. In that case, the question was counted twice 
(or more), once for each feature. Although this occurfed rarely, it did 
not permit a truly separate analysis of each feature of cohesion. Future 
research could be designed to take this" into account. It should be kept 
in mind, however, that texts by nature contain overlapping elements, and 
that any attempt at separation would be artificial. 

d. Mat shing Items of Cohesion With Questions 

It was difficult to match items of cohesion with specific questions. 
Ultimately, this matching was made according to the subjective judgment 
of the researcher. To compare this judgement with that of others in the 
field of EFL, the researcher gave one sample text and questions (Test 2, 
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original and reordered grammatical versions, OG and RG) to a class of seven 
students in the M.A. TESL (Teaching English as a . Second Language) program 
at Tel Aviv Uhiversity, some of Whom were already Reaching EFL, They were, 
acquainted both with M-C testing and Halliday and Hasan (1*976,) • . The 
students were asked to list the items and features of cohesion, if any, 
found in the section (s) of text that needed to be^under stood in order to 
answer each question, .The students worked in groups: two "pairs on the 
.original versiorf and a grotjp' of three on the reordered, version* There. . 
were two native speakers of English: one worked on the original version 
the other on the reordered version* 

The percentage of concurrence between the evaluations of the researcher 
and those of the raters. was not high: the mean was 69%. and the median was 
100J concurrence (see Table 33). A chi-square test for goodness of fit 
yielded no significant values and Kramer's C values were not high for 
either original or reordered versions (C values ranged -from ; .28 ,to .38). . 

The main reason for the relatively low correlations between the 
researcher and the raters was disagreement about how much text needed to 
be read in order ;; to. answer the questions. The inconsistency did not reflect 
a disagreement. oyer the taxonomy or its application. Nonetheless, the' low 
figures would indicate that replicating this experiment would not be an 
easy matter. 
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e. Te at Difficulty and Student Performance 

: ■;< .. • M 

If the texts and questions were too difficult for students scores 

would be too low, the distribution of scores : too narrow, and tHu& no 

significant differences would appear* To a large, e»lent,f this experiment 

depended on the appropriateness of the level of difficulty for the! student 

population. Item analysis indicated that Tests 'M were ,on the appropriate; 

level and that Tests 5-6 were a bit difficult for the students. Given that 

Tests 5-6 were final examinations, however, they needed to?be harder, 

because of departmental requirements, than Tests t-4 which were mid- year 

exams. The differences in levels of- difficulty between the final and 

mid-year exams did not change the general conclusions of this study. 

'4 

f • Reordering: Text or Test 

Test results were based on the Easiness Indices of M-C questions 
answered by students reading the texts. Sin.ce this is an indirect measure 
of text difficulty, one cannot be sure Whether the results i eflect text 
♦difficulty, question difficulty, or both (i.e*, test difficulty).* For 
this reason comparisons were made among the four doctored versions of each 
of the six texts (i.e., original grammatical (0G) f * 'original lexical (0L) f 
reordered grammatical (RG) f and reordered lexical (RL). 

It was not possible, however, 'to compare the six texts to determine 
whether or not they were of equkl difficulty, since the set of questions 
for each text was different. Theoretically,* the same question appearing 
in all six tests could h&ve approximately the same Easiness, Index for each 
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test, provided that the texts were all on the same level of difficulty. 
Empirically, however, it was impossible to ask the same M-C question on 
all six tests. Instead, we assumed that the sample populations were on 
the same level of English proficiency, and we compared mean test scores 
and standard deviations. Thus we found Tests 1-4 to be on one level of 
difficulty (mean scores: 63Z-66J) and Tests 5-6 to be fairly more difficult 
(mean scores: 51%-5W — see Appendix C, Table 18, "Results of M-C Questions 
on Texts Doctored for Grammatical and Lexical Cohesion f n and Table 19> 
"Coherence Results of M-C Questions in Original and Reordered Versions 
of Text. 1 * 

g. Rational Cloze Procedure 

Some students found the large number of items (approximately 40-50 
blanks) frustrating and gave up before the end. There were enough students 
who did finish, however, and statistical corrections were made* The 
unaswered items, like unanswered questions in M-C tests, were removed from 
the final calculations. 

3. Sampling Procedure « 

a. Equivalence of Tested Groups 

The sample was not randomly chosen. Choosing the texts for their own 
classes, it was the teachers who decided which students would read which 
texts. Moreover, the teachers were, convinced by looking at the texts that 
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the reordered versions were more difficult than the original, and were 
therefore reluctant to administer these test versions to their students. 
For this reason, groups were not equivalent in size. Neither was there 
• any guarantee that the Ehglish proficiency of all the groups was equivalent. 
All that can be ascertained is that the English proficiency for the whole 
population was equivalent from year to year. 

b. T est Performance 

Whereas some students do better on tests because of increased motivation, 
other students do worse on tests than during a normal reading situation. 
Tension and nervousness may decrease students 1 reading comprehension 
performance (Ebel, 1979, p. 5). 



C. APPLICATIONS 



1 . Teaching 



This study emphasizes the importanco of context in reading comprehension 
by showing that difficulties are not limited to single lexical items but 
rather related to the connection between ideas in sentences. It confirms 
conclusions also drawn by" Gorman (1 979) and Grellet (1981). Thus 
Grellet: 



But, if reading is to be efficient, the structure 
of longer units such as the paragraph or the whole text 
must be understood. It is no good studying a text as 
though it were a series of independent units. This would 
lead the students (a) to become dependent on understanding 
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every single sentence in a text, even when this is not 
necessary to fulfil their reading purpose, with the 
result that they would tend to read all texts at the 
same speed and (b) to be reluctant to infer the meaning 
of sentences or paragraphs from what comes before or 
after, (p. 6) 

The point of diagnosing difficulties is to be able to help students 
overcome them. A number of techniques for testing clause and sentence 
comprehension and analyzing errors were developed by Corder (1977), who 
also found students lacking the ability to integrate the separate parts 
of the text: 



The first task, as always, is to identify the error. 
Since here we are dealing with a discourse* it may be 
that while the learner can interpret all the parts, he 
may not be able to interpret the logical connections or 
relations between the parts. A study of the learners* 
attempts does, in fact, suggest that this does indeed 
happen, (p. 149) 

According to Corder (1977), Gorman (1979) and Grellet (1981), students 
have difficulty understanding the relations among sentences. Students are 
aware of this problem, according to their answers on questionnaires (see 
Chapter Oie, B.2.a., EFL Students 1 Opinions , pp. 7-9). It would be helpful 
to students if reading comprehension exercises included not only the skills 
of finding the meanings of words and phrases, but also the skills- of 
determining possible sentence functions according to their apearance in 
context (i.e., determining the meaning of a sentence in terms of the 
sentences preceding and following it). That is, teachers could work on 
tables such as Tables 5-10 (see Appendix C) together with students in class 
on any given text — arriving at sentence functions, illocutionary force 
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of paragraphs, paragraph-level concepts, and the general focus of the text 
as a whole. 

Subjective though this exercise may be t it emphasizes the relations 



between sentences and paragraphs. Finding the "correct" sentence function 
would not be the point of the exercise. Arriving at a mutually agreed on 
sentence function or illocutionary force, after discussion of alternative 
possibilities, however, would draw students 1 attention to paragraph structure 
and contextual relations. The usefulness of the exercise would be to help 
students gain insight concerning how items of cohesion relate ideas in a 
given text, how sentences are connected to each other, anu how to identify 
a definition, for example, and to distinguish it from the secondary ideas 
and examples that follow it. In this way, teachers can encourage EFL 
students to read texts and to comprehend discourse rather than to decipher 
single words or decode a series of separate propositions. The emphasis 
when reading should be to see the text as a whole. 
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2. EFL Course and Test Design 

In designing EFL courses and the diagnostic or achievement tests which 
accompany them, course and test designers make decisions concerning 
difficulty. Results of this study indicate that not only vocabulary but 
also aspects of cohesion (e.g., types of sentence and paragraph connectors) 
and coherence (e.g., additive vs. contrastive or top-down vs. bottom-up 
paragraph structure) should be examined and included as well. According 
to their answers to questionnaires (see Chapter One, B.2.C., Discrepancies 
between Views of EFL Students and Teachers , pp. 11-12), students are more 
aware of the difficulties of coherence and cohesion than some teachers. 
Even without pre-testing, course and test designers could briefly scan 
texts for these characteristics to predict level of reading difficulty for 
students. 

3. Testing and Research 

Test results from the various methods were fairly similar : coherence 
was found to be a factor related to reading difficulty whereas cohesion 
could not be directly connected. The Flesch Reading Ease Readability 
Formula, discourse analysis, rational cloze, tests, and M-C questions 
accompanying texts were all used to examine the same phenomenon: the 
possible effects of coherence and cohesion on reading difficulty. There 
was a difference in the kind of information used as the basis for these 
methods. Some methods are based on the text only, whereas others are based 
on students 1 reading of the text, and others on answering questions on the 
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text. These convergent measures pointed to the same conclusion: sequencing 
of information affects reading difficulty. The differences among the 
methods did not not emerge in the findings (i.e., whether or not there was 
* a significant difference between texts caused by coherence or cohesion). 

a. Text-based 

1 ) Flesch Readability Formula 

The Flesch Formula yields a figure which represents a general 
approximation of a text's grade level correct to within a year. Although 
it has the advantage of taking only a short time to calculate, as a 
measurement tool, it Is not very sensitive to changes in text. 

2) Discourse Analysis 

A technique to describe, not measure texts, discourse analysis can 
be used in two ways: 

a) when there are pre-determined .needs of content 
or structure, to determine whether a particular 
text fits the required model 

b) together with test results either to explain 

the statistical results, or conversely, to trace 
the effects of text structure and/or sentence and 
paragrah functions 
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b. Test-based (text + student) 

Care must be exercised in generalizing on the basis of results from 
a tested sample of students to the larger population. Test results depend 
on the appropriateness of the text for the group tested. With this 
qualification in mind, we came to the following conclusions concerning the 
testing methods used in the present study. 

1) Rational Cloze Procedure 

The rational cloze procedure can be used as a measure of text difficulty. 
Depending on the placement of blanks, different kinds of te3ts can be 
obtained. Blanks can be placed to test content words, function words, 
parts of seech, markers of cohesion; these words can be on the micro- 
level or the macro-level. The cloze does not necessarily test the student's 
grasp of the content or ideas in the text, however. 

2) M-C Que st ions 

M-C questions measure text difficulty only indirectly. Easiness 
Indices reflect the difficulty of both the text and the questions. Without 
careful oral incerview work, it is not possible to know how much each of 
these two factors contri* uted to the Easiness Index of any given M-C 
question. Test results of M-C questions can be used, provided that 
questions are fair and present no special difficulties of their own (e.g., 
(Da difficult word in the question that does not appear in the text, or 
(2) a difficult task such as finding a comparison which is implied but not 
q explicitly stated in the text). 
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All of these methods can be used to explain and measure text difficulty. 
The appropriateness of the method depends on the purpose and needs of the 
research study. 

D. SUGGESTIONS FOR FURTHER RESEARCH 

This study was limited to testing advanced students of EFL who were 
reading expository texts. The findings may not necessarily generalize to 
students with lower levels of proficiency, learners of other foreign 
languages, or even readers in the native language. Moreover, different 
results may be obtained for other types of text (e.g., narrative, newspaper, 
scientific, legal, business, etc.). 

The research design in this study may be applied to different populations 
and text types. Native speakers of languages other than Hebrew could be 
tested. Looking for a threshold level at which neither coherence nor 
cohesion affects difficulty more than for native English speakers, researchers 
could examine students with different levels of proficiency (i.e., less 
advanced or even more advanced than in this study). 

Three aspects of text analysis were examined as possibly contributing 
towards the difficulty differences resulting from the reordering of sentences 
in each text. Cohesion and two aspects of coherence (i.e., top- down/bottom-up 
structure, additive vs. contrastive structure) were factors found in this 
study. Identifying and testing other factors would be another possible 
area of research* There were indications, for example, that certain features 
of cohesion (i.e., substitution, especially clausal, and ellipsis) were 
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linked to reading difficulty. Further research could be designed to single 
out these features and test this hypothesis. According to Schwartz (1983), 
in addition to the sequencing of information t the distance between 
propositions and staging were also factors that affected learning. Possibly 
they may affect reading difficulty as well. Further research could test 
this hypothesis. 

Research in contrastive discourse analysis, like Kaplan f s (1966), 
would be helpful in mapping the different prose conventions, on both micro- 
and macro-levels, between English and other languages. Knowing the kind 
of prose conventions Israelis are familiar with would help teachers point 
out differences between English texts and those in the native language. 

Alternatively, the same sample population could be given texts of 
different difficulty levels to find the threshold level for that population. 
Comparisons could be made among text types. Because of the large number 
of* students tested, certain test types (e.g., short answer, summary, 
translation of continuous prose) were not used in this study. Given smaller 
samples of students, these methods could also be applied. 
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E. GENERAL CONCLUSIONS 

The impetus for this investigation arose from the EFL classroom 
situation. Not much is known about the reading processes of advanced 
foreign language learners. Research has been carried out mostly on text 
recall and elementary reading by native speakers. There are so many 
variables affecting foreign language research (e.g., the learners language 
background and nunber of years of foreign language study, the tex^s subject 
matter and complexity, various methods of learning, the difficulty of 
finding students who can be studied over a fairly long period of time, 
etc.) that research in this field is not an easy matter. Yet without raw 
data and basic facts about how advanced foreign learners actually read, 
present teaching materials cannot be improved. Unless we can identify the 
obstacles to reading, we cannot teach students how to overcome them. 
Initially, then, the need for more information on reading behavior inspired 
this study. 

To find obstacles to reading, special testing methods were devised: 
the doctoring procedure with both M-C and rational cloze items. Discourse 
analysis .was used to describe the texts included in the tests, and* the 
results were interpreted in the light of psycholinguistic theory. Although 
most of this theory had been developed using native speakers, the resulting 
hypotheses were applied to this study of advanced EFL learners. TWo major 
hypotheses were investigated: the "chunking* theory whereby readers 
reorganize information and, when necessary, supply missing links between 
propositions, as opposed to the notion that sequencing of information in 
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a text is important and that each new bit modifies the given information 
that preceded it. These hypotheses about text coherence were supplemented 
*>y classification of markers of cohesion which linked propositions overtly. 
• Although both these hypotheses have been shown to be operative for native 
speakers, depending on the level of proficiency in reading (Marshall and 
Glock 1978-79 ) f they have not yet been researched for advanced foreign 
language learners. The extent to which these processes occur in our EFL 
readers was found to depend on how difficult the students found the texts 
to be. 

When students found texts easy to read, sequencing of information did 
not significantly change test results, and it was assumed that fl chunking tt 
occurred. When students found obstacles (i.e., according to this study, 
contrastive paragraphs, bottom-up structure, certain cohesive items), then 
the significantly lower test scores could be attributed to changes in 
coherence (sequencing) and/or cohesion. 

This study is an integrative exerci3e in applied linguistics, baseJ 
on methods and findings in the fields of educational measurement, 
psycholinguistics, and discourse analysis, and applying them to the classroom 
situation. It Is hoped that EFL course designers and teachers will use 
the findings of this thesis and make students aware of coherence and 
cohesion. 

From the researcher's own experience in the classroom, exercises which 
increase SFL students 1 sensitivity to the linking devices in English texts 
also make them more aware of such devices in their native language, to the 
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surprise of many, for the first time. Thus training students to recognize 
markers of cohesion and to focus on the relations between sentences helps 
them to cope with difficult EFL texts, and at the same time, to become 
better readers even in their native language. 

Coherence and cohesion are not merely descriptive theoretical constructs, 
but integral factors in the reading process. An awareness of how they 
operate in texts will help EFL students to become more proficient 
readers. 
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NOTES TO CHAPTER SIX 

1. Edward Levenston, personal communication. 

2. Thanks are due to Dr. Elite 01shtain» Department of Education Tel 
Aviv University, and students in her M.A. TESL seminar in discourse 
analysis. 
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AFfrKMDIX A 240 
QUK3TIGNNAIRES FOR 3TUPEMT3 OP ENGLISH A3 A FOREIGN LANGUAGE 



1. COURSE; Advanced Course in English^ 
Regular Couree in English^. 



Mechina 



2, Native Language 



For each of the features listed, indicate your opinion on page 2. 



A. Do you find this feature diff ioult .when reading a text? 

1, extremely difficult 

2, fairly difficult 
3* fairly easy 

4# easy 

5* don't know or doean't apply 

B» In order to be able to understand a text in English, 
aautery of this feature ia 

1. absolutely essential 

2. important but not essential 

3. not necessary 

C. In the course you have just taken ( or are now taking) 
this feature was taught 

1, always 

2. Often 

3* nam times 

4. rarely 
5» nevar 



YOUR HIERARCHY t (A to P) 

aoat important moqt difficult 



1 • 

2 - 

3 - 

4 - 

5 - 

6 - 



1 - 

2 - 

3 - 

4 - 

5 - 

6 - 
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SUMMARY CHECKLIST OP PEATUHBS CAUSING DIPPICUIffY IN 
REiADl N3 C0KPHKHKM3I0N 

C 



A. 



Oraphlc Or«»»nlztttlon 

b ability to analyse a pun^rnj.h 

2". aake uuo of information found In the title, 

httftdlngH, aubhewiin«e 



3.knowled<$e of citation procedure (footnoting reference; 



Hhetofical devicea; argumentation — recognising 
definition und claeuif ication 
example*, illuatratione and abstract ideaa 
oompariaon. contract 
caaaal relationship/ caU30 and effect 
rhetorical <jueutlon and anuwer 
atatumuvt and restatement 
explanation, clarification, description 
generalisation vs. evidence, fact 
inference, i*pUeatiou 

summary vat accumulation of detail or listing 



-V, 

1. 



-c: 



"7." 

3; 



10. 



C. Vocabulary 



-J5* 



abul ary , \ 

I • terminology <> r ^ 
?7 contextual aynoynoua paraphaee (recognition or 
— - word/ phraBrt equivalents) 

word families (stem) 
affixes and rootfl (word formation) 
multiple denotations- wid connotationa of u word 
false cognates 
metaphor a 
pnrauul verbs 
collocatione 9 idioms 

languw:*' of caution, strength of claim, truth modilier 
nomlnall stations (use of abutract nouns xiiutcui of 

verba to indicate activity — ie, divi aiun/di vidi.%g 



C. 
7. 



IlCu 



0* ty/itax » aid Griuritiar 

1 t punctuation 

Hi.Uity to recogn I -ic verb in a clauae 
~3 # ability to recognise dependent and independent 

cluuaeu (subordination) 

4 # reference 

*j. noun modifiers (rank shift, determiners) 

"J ~ft t adverb! nla 

7. transformations (It, There is, Paeuive, Cleft Sentence, 
Queutiunu/ttequeate) 

J # Tonne, models, time sequence, If (conditionals) 

ncntence connectors (however, yet, since) 

T6, reduced relative clauaeu ( tlmt left out before 

de|*;fident clfcuiui — ie, He aaid he'd come* •••• 

property he needed) 

Author 1 a invol vement in text 
J, purpose 
uutii Mice 
tone 

"4. degftiS of formality 

~«T. which aide of the arguioent he la on (What argument?!) 
"C. evaluation and opinion 



B. 



aelf-conf idence in reading, attitudes 
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APPENDIX A 

RESPONSES OF EFL STUDENTS AND TEACHERS TO QUESTIONNAIRES 



In order of difficulty, the students 1 opinions resulted in the following 
hierarchy: (1 a most difficult, 6 s easiest) 



TABLE 1; EFL Students 1 Opinions on Text Difficulty 
Required Course (67 students) 

1. vocabulary 

2. rhetorical function 
3» syntax/gn mar 

*». author's involvement 

5. reader's attitude 

6. (graphic organization received few votes) 



Pre-Academlc Courses (38 students) 

1. vocabulary 

2. rhetorical function 

3. syntax/g"%mmar 

4. graphic organization 

5. authors involvement 

6. reader's attitudes 
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In order of importance, the students' opinions resulted in the following 
hierarchy: (1 s most important, 6 s least important) 

TABLE 2: EFL Students y Opinions on Features of Importance in Reading 

Required Course (67 students) 

1* syntax/grammar 

2. vocabulary 

3* rhetorical function 

4. author's involvement 

5. reader's attitude 

6. (graphic organization received few votes) 



Pre-Aoademlo Courses (38 students) 

1« vocabulary 

2. synxtax/ grammar 

3* rhetorical function 

4. graphical organization 

5* reader's attitude 

6. author's involvement 
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APPENDIX A 244 

In order of difficulty, the teachers 1 opinions led to the following 
hierarchy: (1 s most difficult, 6 = easiest) 

TABLE 3: EFL Teachers' Opinions on Text Difficulty 

1. author's involvement 

2. rhetorical functions (illocutionary force) 

3. vocabulary 

4. syntax and grammar 

5. graphic organization 

6. (reader's attitude not mentioned) 



In order of importance, the following hierarchy resulted: (1 = most 
important, 6 = least important) 

TABLE 4: EFL Teachers 1 Opinions of Features of Importance in Reading 

1. reader's attitude 

2. vocabulary 

3. syntax and grammar 

4. rhetorical functions (illocutionary force) 

5. graphic organization 

6. reader's attitude (Opinions were split as to whether 
it is most or least important.) 

7. (author's involvement not mentioned) 
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XPPflNDIX B 245 
TEXT 2 — original 

I World population growth and hew to slow it — 

continues to be a subject of great controversy. Ohe 
planet's poorest nations have yet to find effective ways 
to check their population increase — at least without 
5" restricting citizens' rights and violating such traditions 
9 9 as the custom of having large families as insurance in old age. 

Population growth io the gravest issue the world faces over 
the decades immediately ahead. In many ways it is an 
even more dangerous and subtle threat than war, since it is 
jO less subject to organised control.lt is not in the exclusive 

control of a few governments , but rather in the hands of hundreds 
of millions of individual parents. The population threat 
must be faced — like the nuclear threat — for what it 
inevitably is: a central determinant of mankind's future, 
K one requiring far more attention than it is presently receiving. 

Last year the world's population passed 4 billion. Unless 
thgrejis a holocaust brought on by man or nature, the world's 
population will continue to increase. While the growth rate 
in the developed nations is actually slowing down, the rate 
(±) lc in the developing countries is accelerating rapidly. The 

problem, then, is to control the population growth in the 
developing countries where fertility is high. 

What, then, are some of the specific social and economic 
actions most likely to promote the desire for reduced fertility? 

If The inqx>rtance of enhancing the status of women is critical. 
Of all the aspects of social development, the educational 
level appears most consistently associated with lower fexility, 
so that an increase in the education of women tends to lower 
I ij fertility to a greater extent than a similar increase in the 

}o education of men. In Latin America, for example, studies 

indicate that women who have completed primary school average 
about two children fewer than those who have not. Schooling 
tends to delay the age of marriage for girls, and thus reduces 
their total possible number of childbearing years. 0ri 

*54 
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TEXT 2 — original - 2 - 



A number of governments are moving in the direction of 
coercion. Some have introduced legal sanctions to raise 
tha age of marriage . A few are considering direct legal 
limitations on family size and sanctions to enforce them. 
No government really wants to resort to this. But neither adapted 

any government afford to let population pressure grow 
so large that social frustrations finally erupt into irrational 
violence and civil disintegration. 

Furthermore, through an increase in income, families 
will almost certainly experience a bei§Eicial decline in their 
traditionally high fertility. For the income will give them 
access to setter health and education and living standards, 
which in turn are likely to lead to smaller families. 
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Haifa University 

Department of Foreign Languages 



Regular Course 
Mid-term Exam 1979 



TEXT 2 



PL version 

original coherence 



5 

(1) 

10 
15 

20 

(2) 



World population growth — and how to slow it — lexical cohesion 
continues to be a subject of great controversy. The 
planet's poorest nations have yet to find effective 
ways to check this population ir crease — at least 
without restricting citizens 1 rights and violating 
such traditions as the custom of having large families 
as insurance in old age. Population growth is the 
gravest issue the world faces over the decades immediately 
ahead. In many ways an increase in the earth's population 
is an even more dangerous and subtle threat than war, 
since a rise in the number of the world's inhabitants 
is less amenable to organized control . The problem is 
not in the exclusive control of a few governments, but 
rather in the hands of hundreds of millions of individual 
parents. The population threat must be faced — like the 
nuclear threat — as a central determinant of mankind's 
future, a problem requiring far more attention than is 
presently given. 

Last year the globe's population passed 4 billion. 
Unless thre is a holocaust brought on by man or nature, 
the process will continue. While the growth rate in the 
developed nations is actually decreasing, the rate in the 
developing countries is accelerating rapidly. The problem, 
then, is to control the population growth in the 
developing nations where fertility is high. 



ERLC 



256 




Haifa University 

Department of Foreign Languages 



Regular Cour5c 
Mid- term lixam 1970 



TEXT 2 



PARAGRAPH 



30 

(3) 



(3) 



(4) 



(5) 



What, then, aro some of the specific social and 
economic actions most likely to promote the desire for 
reduced fertility': The importance of enhancing the status 
of women is critical. Of all the aspects of social 
development, the educational level of females appears 
most consistently related to fertility, so that an 
increase in the education of women tends to lower fertility 
to a greater extent than a similar increase in the 
ethical ion of men. In Uitin America, for example, studie s 
35 indicate that women who have completed primary school 
bear about two children fewer than women who have 
failed to continue. Schooling tends to delay the u^c 
of marriage for girls, and thus diminishes the total 
possible number of chi Idhcaring years. 

40 hirlhcrmorc, through an increment in income, 

families will almost certainly experience a beneficial 
decline in i heir traditionally high fertility. For 
the earnings will give access to better health, 
education and living standards, which, in turn, are 

45 likely to lead to smaller households. 

A number of governments are moving in the* direction 
of coercion. So,*ie governments have introduced legal 
sanctions to raise the age of marriage. A few 
governments are considering direct legal limitations 
50 on family size and sanctions to enforce the new laws. 
No governments really want to resort to the use of 
force. Uut neither can any government afford to let 
population pressure expand so that social frustrations 
finally erupt into irrational violence and civil 



55 
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Regular Course 
Mid-Term Exam 1979 



PARAGRAPH TEXT 2 QG vorcion 

• ori/iml coherence 

1 World population growth — and how to slow it-- crawrxticd coi.c-s*c 

continues to be a subject of grant controversy* The 
world's poorest nations have yet to find effective 
ways to slow this growth -- at least without restricting 
5 citizen^' rights and violating such traditions as 
the one of having large families as insurance in old 
age. Population growth is the gravest problem the world faces over 
(1) the decades immediately ahead. In many ways it is 

an even more dangerous and subtle threat than war, 
10 since it is less amenable to organized control. It 
is not in the exclusive control of n few governments, 
but rather hundreds of millions of individual parents. 
It must be faced -- like the nuclear threat --for 
what it is: a central determinant of mankind 9 s 
15 future, one requiring far more attention than at present. 



Last year the world's population passed 4 billion. 
Unless there is a holocaust brought on by man or 
nature, it will continue to increase. While the 
growth rate in the developed nations is actually 
20 slowing down, in the developing countries it is 

increasing rapidly. The problem, then, is to slow 
this down in the developing countries where fertility 
is h i gh , 
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Haifa University Regular Course 

Dept. of Foreign Languages Mid-lerm Exam 1979 



(TEXT 2 — cont'd) PC version 



What, then, are some of those specific social 
and economic actions most likely to increase the 
desire for reduced fertility? The importance of 
enhancing the status of women is critical. Of all 
the aspects of social development, the educational 
level of females appears most consistently related 
to fertility, so that an increase in their education tends to 
lower fertility to a greater extent than does a similar increase the 
education of men. In Latin America, for example, 
studies indicate that those who have competed primary 
school bear about two children fewer than those 
who have not. It tends to delay their age of 
marriage, and thus reduces their total possible 
number of childbcaring years. 



Furthermore, through an increase in income, 
families will almost certainly experience a beneficial 
reduction in their traditionally high fertility. 
For this will give them access to better health, 
education and living standards, which, in turn, are 
likely to lead to smaller families. 

A number of governments are moving in the 
direct- -m of coercion. Some have introduced legal 
sanctions to increase the age of marriage. A few 
are considering direct legal limitations on family 
size and sanctions to enforce them. No governments 
really want to resort to this. But neither can they 
afford to let population pressure grow so 
large that social frustrations finally erupt into 
violence and civil disintegration.. 
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Haifa University 

Dept. of Foreign Language 



Regular Course 
Mid-Term Exam 1979 



QUESTIONS ON TP.XT 2 ^i»ii£|Arewfl 

1. According to the first paragraph, the poorest countries 

1. have already found ways to slow down population growth 

2. have not found ways to slow down population growth 

3. want to find ways to speed up population growth 

4. will soon easily find ways to slow down population growth 

2. According to the first paragraph, the custom of having large 
families 

1. is not insurance against poverty in old age 

2. is a tradition that the poor are not able to give up 

3. is an effective way to check population growth 

4. must he slopped, even at the risk of restricting 



3. "the gravest 11 (line 7/8) means 

1 . the deadl iest 

2. the lowest 

3. the heaviest 

4. the most serious 

4. "since 11 (line 10/11) means 

1 . towards 

2. although 

3. because 

4 . unless 

5. According to the first paragraph, population growth and w;ir 

1. are the world's greatest problems 

2. are equally dangerous problems 

3. are less dangerous than government control 

4. will not be real dangers in the near future 

0. According to the first paragraph, what Ls not in the exclusive 
control of governments? 

1. thermonuclear war 

2. population growth 

3. citizens 1 ri ghts 

4. organized insurance 



citizens 1 rights 
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a«S 2 flrSt ™<> h - « *».t give enough 



attention to 

1. nuclear threat 

2. population growth 

3. mankind's future 

4. government control 

tTTntlLT W ° rld ' S P°P ul ^ion is sure 

1. providing there is no holocaust 
if there is ever a holocaust 

3. because there has been a holocaust 

4. as there may be a holocaust 

According to paragraph 2, the world's main problem is that 

In In n^-°" S P°P ulation g^wth is slowing down 

he non ? t ,0nS w0rld , P°J ul »tion growt.. is increasing 
the population growth of rich nations in increasing 

a?thn? P ! fllT f ° Wth ° f P00r nations " increasing 
although that of rich nations is slowing down 

suggests"" 0 " ^ redUCC W^ 1 ™ *«"th. ^ paragraph .3, th« 

1. making women feel more important 

2. raising women's social status 

3. giving women more education 

4. delating the age of marriage for girls 

He writer gives Latin America as an example of a country wher 

J. educated women have only two children 
educated women have fewer children 

3. educated men have fewer children 

4. the general educational level is low 

According to paragraph 4, reduced fertility is . result of 

1. more education for men 

2. decreasing the age of marriage 

3. a decline in living standards 

4. greater income for families 

"will almost certainly experience" (line 39/41) means 

1 • may possibly experience 

2. may certainly not experience 

3- will definitely experience 

4. will probably experience 
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14. "For" (line 41/42) means 

1 . whether 

2. unless 
3# because 
4, although 

15. "are likely to lead 11 (line 43/45) means 

# 1 . are plcasurubly leading 

2. are similar to leading 

3. will probably lead 

4. will easily lead 

16. According to the last paragraph, some governments have to choose 
between 

1. letting people starve and finding them jobs 

2. permitting social disintegration or resorting to legal force 

3. increasing family income or enforcing legal sanctions 

4. improving public education or delaying the age of marriage 

17. The writer ends this text w*tn 

1. an example of a particular problem 

2. advice on how to improve education 

3. a description of the advantages of population growth 

4. a threat of what may happen 

18. A good title for this text would be 

1. The angers of Limiting Women's Fducation 

2. Some Ways of Slowing [Jown Population Growth 

3. The Advantages of Birth Control 

1. Government Control of Population Growth in Developed 
Countries 

19. The tone of this text is 

1 . humorous 

2 . sedat e 

3 . urgent 
A . fearful 

20. in this text, the writer's main purpose is to 

1 . compare two problems 

2 . contradict someone's ideas 

3. narrate a story 

4. convince the reader 
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lexical cohesion. 

, x^t yea, the wojd'. population paomed 4 billion. Mhila th. growth 

rate in the developed nation, la actually -lowing down, the rat. in the 
deveiOj.ii* countries i. accl.rating rapidly. Population growth is the 
grav.al issue the planet fuceo over the decode, j^^atel* tthead « 
5 Unlaw there ic a holocaust brought on by man or nature, the proceo. 
will continue. The problea, then, is to control the population 
growth in the developing countries whew fertility is high. 



Th. globe 'a poorest nationn have yet to find effective ways to 
check th. population increaae -at leant without restricting 
citizens' rights, and violating ouch tradition, a. the custom of 

,0 having lur^e families as insurance In old age. A number of 

govenw-.nl.. ore moving in the direction of coercion. Ho government, 
really want to resort to the use of force. But neither can any 
government afford to let populating pressure grow oo large that 
social frustrations finally arupt into irraUonal violence and 

t5 civil disintegration. 

The problem in not in the eicluaivo control of a few government, 
however, but rather in the handa of hundredo of milUona of 
individual parents. What, then, are some of the specific social 
and economic actiona moat liJceiy to promote the desire for reduced 
20 fertility? A few governm.' considering direct legal limitations 

on family sisa and sanction. 'area the new lawa. Some governments 

have introduced legal uinctionn to raise the age of marriago. 

./2 
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APl'i:»iMQ 

VOKLD lUPUUTIOtl GROWTH & "MM 



1 met? 



(4) 



IWUmruora. through an incr-ent in ino—, f-lU« will al«.t 

certainly .ip.ri.ac. a ban.fici.1 * ^ W* 

., 5 fertility, ror th. ^ will 0« -oca. * batter n~lth «d fcj) 
' .auction end living uUndurd.. which in turn nr. Ilk* to lead to 

uaaller houreholda. 

Of 11 th. aepacta of social dNdqMt. th. .ducation* level of 
W. app.urn.oat coaaiefaiir an*ocl«t«l with lower futility. 

„ ao that an increaa. in ft. ^cation of woaen tand. to lOW.r frUUt, 
to a greater .xtant than a airier inc^aa. in th. education of men. 
Schooling tenda to delay ft. a*, of -arria«. for *rl>, and thus 
Ovinia,,., th. total poaelbl. nueber of childb-ring y.ara. In I*ti» 
America, for —pi., atudiao indicate that w»en who hat. co.pl.fd 

)b priory uchool m -tout two childran f.w.r than w«en who hav. 
failed to contxnu.. The importance of enhanclnc tb. ototao «f woman 
ia critical. 

World population growth - and how to alow it - continue to b. 
a reject of er.ut controversy. In -any waye an increaae in th. 
„ earth':; population ia an .van nor. d^roua end aubtle threat than ^ 
„ax, uinc. a riae ia th. nuaber of th. world', inhabitant, ia l.sa 
anenuble to ortfinUed control. Th. population thmt Ktf be faced - 
like the nuclear threat - « e central u.teminent of nanfcind'e 
future, a problem requirinc far .ore attention than i. presently tfiv.n. 

(lezioal) 
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WOULD WFUUTIGM CKOflH TEH 2 Rf ? yens ion _ 

reorrif-rtrd cobi- runco 
grammatical fioi.iihion 

1 ittfttj itf>rit#:rui»i< 



(0 



1 Uot jaar tha war Id 1 • population ptmd 4 fcUllon* WhUo tha 

gwwth rata in tha davwlopad mUcm la aattfall/ alawing dawn, in tha 
UuvAio^i^ oouatriaa li It aooalamtUf rapidljr. It is ftha grmat 
jiroUlaa tha world faoaw avar tha daotdoa M; ataljr ahaad* unlaaa 
thora !• « holooauat brought on Igr ma oar MUn t li will contLnua » 
Tba problan, thw, is to iIm this dm la tha uaYtlojdng aouatrioa 
whora fortuity is high* 



Tha world 1 * paoraot aationa bin ywt to find affaottta wajr« 
to ohaok thla growth — at laaat without raetrleting altlsaaa 1 

10 right u And violating tuoh tradition* aa th*t of Urine lArgv ^ j 

fttttilloM an Umnm oo la old ago, A mtbtr of govarmonto art 
luuviitf! iii tha dirtotlcm of ooaralom Bo gonrwnonta raaliy want 
to ranort to thla, fiut mlihw oan thay afford to lot population praaa- 
ui-o grow so largo that aoolal fruatratlaaa finally arupt lata 

t S lrratiouJ v i 0 i #no# and ^1 dlaintagrattaau . 



PoiAilatloa growth la not in tha axalualva control «f a f aw 
gortroaanU, howayar, hut rathar hundrada af nUUona of Individual 

paranto. than, ara aoa* af thaaa apaolfla aoolal and aoowwio 

action* noet likaly to laoraaaa tha daalra far raduoad fartUityt 
» 0 a faw govarmaata ara oonaldarlng dlraat lagal limitation* an family 
alu a*d eanotlona to anforoa that. Bona haw* intraduoad lagal 
aanotiona to ralaa tha ago af aarrlaja, furtu*r»ora # through an 

BEST COPY AVAILABLE 



257 



VUCLP IWUU'JAUfl UllOWlU ,» no vorttion - 2 - 



iacxoum lu iuvm; faailio* will alaoot oarUlal/ «*Farfanoo a 

; i*i*aoiu r ^ U cUon vroiMiwJJof hi** fartm*. r«r thta (3) 

^ will Xhm aocao* to Uttar hoalth tod otuaattoa and UTia* atandardo, 

which in turn ara likely to loud to oauller 



Of all tho aajwct* of ooclal dmlo|Mot 9 tha oduoattooal lotol 
of f«*ulo*j topi«uru Hoot oaaaioUntly aaaooiotod with Urnmr fortuity, 
ho that on i nor out* lo tioir oducatioo Undo to loaar fortuity to a 

30 creator •itent Vmn dooo a al*iUr looroaao la tha a du o attoo of «aa« 
It UiMlu to doloy thoir of aarrl*aa # and thus roduoaa thalr total 
poealblo nu*bor of ohlldboarlAtf yaary. In Utin A*ar5oa # for axatt^lo, 
atuiUoo iiuUouU U«t thouo who liavo oofcplotod priaary oobool bnr 
nbout two uldfclnu f«w«r. Tua i*»i>orWnoa of ralalaa thair otatua la 

yj oritloftl* 



40 



World imjijuIaUoo growth — oM how to alow it — ooatlauM to La 
o uubjoct or ifr«*t cootrovoray. Ia uuy woyo it is an avao ftoro 
diu^rvuu uiid Mibtlo throat than v*r» ainoa it le laaa aaanabla to 
©rtfuoizod control. It mxbt bo f*o#d — lika tha mioloar throat — 
for what it inovitahly lwi a oaatral da tamioaat of aaoklivl'o futuro, 
ror|ulriUi: far aora atUntlon thai: it io proaantly receiving, 

d;ruiauutlCul) 



(4) 



(5) 
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AI'IWHiIX B_ 

Haifa University 
Department of Foreign Languages 

Questions on Text 2 

1 the gravest (paragraph 1) means 

1. the deadliest 

2. the lowest 

3. Uie heaviest 

4. the most serious 

2. According to the first paragraph, the world's population is sure to increase 

1. providing there is no holocaust 

2. if there is ever a holocaust 

3. because there has been a holocaust 

4. as there may be a holocaust 

3. according to paragraph 2, the poorest countries 

1. have found ways to slow down population growth 

2. have not found ways to slow down population growth 

J. don't want to find ways to slow down population growth 
4. will soon find ways to slow down population growth 

4. According to paragraph 2, the custom of having large families 

1. is not insurance against poverty in old age 

2. is a tradition that the poor have not been able to give up 
i. is an effective way to check, population growth 

4. must be stopped, even at the risk of restricting citizens' rights 



5. r oe re inn (paragraph 2) means 

1. torcc 

2 . change 

3. leniency 

4. education 

b. according to paragraph 2, some governments have to choose between 

1. lotting people starve or finding them jobs 

2. resorting to legal force or permitting social disintegration 
3! increasing family income or enforcing legal sanctions 

4. improving public education or delaying the age of marriage 

7. according to paragraph 3, what is not in the exclusive control of governments? 

1. thermonuclear war 

2. population growth 

3. thr.» world 

4. organized control 

0. will al most certainly experience (paragraph 3) »eans 

1. may possibly experience 

2. may certainly not experience 

3. will definitely experience 

4. will probably experience 

9. Por (paragraph 3) means 

1. WhcLlu*r 

2. Unli-ss 
J. Uc*c\iU:,e 
4. Although 



ERLC 



10. arr likely tjo le ad (paragraph 3) means 

1. ace ploasurably leading 

2. are similar to leading 
J* will probably lead 

4« will easily lead 
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Hicst ions on Text 2 (cont'd) 



ypordepgd coherence 



11. As a way ot reducing population growth, in paragraph 4, the author suggests 

1. making women feel mora important 

2. raising women's salaries 

3. giving women more education 

4. delaying Uie age of marriage for girls 



12« thus; (i»rtrd'jra|ili 4J 

X t id this w.i/ 

2. in bjiite of 

* J. iu contra tit 

* 4. in general 



means 



13. 'Hie author jives Latin America as an example of a country where 
1* fit uca ted women have only two children 
2. educated women have fewer children 
\. educated men have tewer children 
4, the general educational level is low 

14 • since (paragraph 0) moans 

1. tuwauls 

2. although 
.!« hooaus*; 
4« unless 

15. According tx> the juragraph 5, |>opulation growth 
J. is the world's greatest danger 
2. will not be a real danger in the near future 
J • i:; a less serious danger than war 
4. in as great a danger as wax 

it.. Accenting lo paragiaph 5, we don't give enough Attention to 
J . mid rar Hi it 
2. I*>pulat ion gt nwth 
I. uui.iKind *:i future 
4. the 4 billion turk 

17. The author ends this text with 

]. an example ot a particular problem 

J. advice on how tu improve education 

1. a description ot the advantages or population growth 

4. a tht eat ot what may happen 

1U« A possible title for this text would he 

1. The hangers of I. uniting Women's Education 

2. Sunn* Way:; of Slowing Down Copulation Growth 

1 . The 1'ioblems ot Large Families in beveloping Countries 

4. (lovernment Control of Population Growth in Developed Countries 

Pi. The tone of this text is 
i • huinoiftu:* 
* . |kO»:*l<JltUtC 

J. oh)i,-ctive 
4. teuliul 



20. The author ot thid text is trying to 
1 « del i lie* certain ideas 
2. contradict someone's ideas 
J. itairate a utory 
4. convince the reader 
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Foxa 1 - original 
coUerenc 



0 

ERIC 



World population growth — and how to slow it — continues 
to be a subject of great controversy. The planet's poorest 
nations have yet to find effective (1) to check their 1) 
population increase ~ at least without (2) citizens' 2) 
rights and violating such traditions (3) the custom of 3) 
having large families as insurance in old (4) . Population^ 
growth is the gravest issue the world faces (S) the decades 5) 



immediately ahead. In (6) ways it is an even more 



6) 
7) 
8) 
9) 
10) 
11) 



dangerous and subtle (7) than war, since it is (») 
subject to organised control. (9) growth, however, is 
not in the exclusive control of a few (10) * but rather 
in the hands of hundreds of (11) of individual parents. 
The population threat aust be faced — like the nuclear 
threat — for what it inevitably is: a central determinant 
of Mankind's future, one requiring far sore attention than 
it is presently receiving. 

Lust year the world's population passed 4 billion. Unless 
thero ill) * holocaust brought on by man or nature, the 12) 
[13) population will continue to increase. While the 11) 
growth rate in the developed (14) is actually slowing 14) 
down, the rate in the developing countries is (IS) r apidly. IS) 
The problem, (16) , is to control the population (17) in 16) 
the developing countries where fertility is (18) * 

What, then, are (19) of the specific social and 18) 
economic actions (20) likely to promote the desire for 19) 
(21) fertility? The importance of enhancing the status 20) 
of women is (22) . Of all the aspects of social 21) 
development, the educational level appears most consistently 22) 
associated with (23) fertility, so that an Increase in 23) 
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NORIi) POPULATION GROWTH CLOZE PASSAGE 2 Fom 1 

the (24) of women tends to lower fertility to a greater 24) 

extent than a similar (2S) in the education of men. In 25) 

Latin Amarioa, fos (26) . studies indicate that women who 26) 

have completed primary school average about two (27) fewer 27) 

than those who have (28) . Schooling tends to delay the 28) 

u t° of GiU tor E ir * s * * nJ thus reduces their total 29) 

possible number of childbearing y*ars< 30) 

(30) > through an increase in income, families will 31) 

almost certainly (51) a beneficial decline in their 32) 

traditionally high fertility. For the (321 will give then 33), 

acccbb to (33) health and education and living standards, 34) 
which in turn are likely to lead to (34) families. 

A number of governments are moving (35) the direction 35) 

of coercion. Some have (30) legal sanctions to raise *he 36) 

age of marriage. A few governments are considering direct 37) 

ltt * al ( 37 ) on family size and sanctions to enforce them. 38) 
No governments (38) want to resort to this. But neither 
can any government afford to let population pressure grow so 
large that social frustrations finally erupt into irrational 
violence and civil disintegration. 
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WORLD POPULATION GROWTH CL028 PASSAG8 2 2 ' JJ^IZ! 

U»t th. world'. popuUtion p...*d 4 billion, tfhtl. 

th. growth r.t. in th. d.v.lop.d JiL, i» Rowing « _ 

down, th* m. in th. d.v.loping countriM »P idl * 2) — 

' Por-Ution growth i. th. gr.v..t i..u. th. world fee.. J^- « — 

' th. d.cd.. i--di.t.ly *«d. U»I.» th.r. J4}_. holocu.t 4) _ 

brought on by «. or n.tur.. th. jg. ******* " l " contlnu * 5) - 

to incn,.... Th. probl-. J6^ U to control th. popuUtion 6) 

(7) m th. d.v.loping countriM wh.w fertility i» JBJ • 7 ) _ 

Th. pUMt's poowct n.tions h.v. y.t to find .ff.ctiv. 8) _ 

J9J_ to ch.ck th.ir popuUtion incr.M. - .t li»t without 8) _ 

J10_citix.n.'right. «m! vioUting «uch tr.dit*on» Jiil 1°) _ 
th. custo. of h.ving l.rg. talllM M ln.ur.nc. in old J12J. .II) 

A nunbor of gov.n-.nt. .r. -oving J13}. th. direction of 12) _ 

ccrcion. No gov.rnMnts JJfl MM to r..ort to thi.. But 13) _ 

n.ith.r cm gov.rn.«it .fford to Ut popuUtion pr...ur. 14) _ 

grow so Urg. th.t soci.1 fru.tr.tions fin.lly .rupt into IS) _ 

irr.tion.l vioUnc. *nd civil di.int.gr.tion, I6 > - 

jlS) growth 1. not in th. .*clu»iv. cot.erc-1 of . f«« 17) _ 

(l6)t howov.r. but r«th.r in th. h»nds of hundwd. of _£i?J__ ") _ 

of individu.l p.r.nt.. Mint. th«. .r. JUL. ° f th. .p.cific 19) _ 

>ocl.l .conowic .ction. (19). "k"/ to P* 0 " 0 " 20) - 

th. d.sir. for (20) f.rtilityj K f.w gov.rnwnt. »r. 21) _ 

con,id.ring diwet Ug.l J2J1 <* ,l " ™ ctimt 22) - 

to .nforc. th... So., h.v. J22), Ug.l wction. to r.i.. 23) _ 

th. .g. of wrri.g.. J£L . through m incr.... io incow. 24) _ 

fwiliM will .l*Jt crt.inly J2& . b.n.fici.l d.clin. 25) _ 

in th.ir tr.dition.lly hith fertility. Por th. J25j_will 26) _ 

glv. th- .CO. to J26J.- hMlth Wd auction «d living 27) _ 
it.nd.rd., which in turn «• lik.ly to Ltd to _J2Jl f«ili.s. 
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Of all th. *«p.ct. of »ocl.l d.v.lop».nt. th. .ductlon.1 

l,v.l .ppcr. «o,t con.l.t.ntly ..wcLcd with j&L frtiUty. 28) 

•o th«t « lncr.c. in th. J29). of *o».n t.nd. to lo*.r 29) 

tirtillt/ to a grwt.r .*t.nt thw » »talUr 152L *» ll * 30) 

•duc«lon of MX. Schooling t.nd. to d.lay th. >g« of J3J1 31) 

for girl.. -M thu. wduc. th.lr tot.l possibl- rvsixr of 32) 

chlidbcrlng y..r.. In Utln A..rl«. for J32). . ttiuUM 33) 

indict. thu «o«n wl* novo co.pl.fd prfry .chool »v.r*g. 34) 

•bo«t two (33) fmr t»i»« tho.. who h.v. _i34}_. Th. 3S) 

Uportnnc. of .nh»nclng th. »t.tu» of momii It J£Lf 3,,) 

World population growth -- «nd ho* to slow It — 37 ) 

continue. t» h. • »ubj.ct of gr..t controw.r.). In J36}_ 3«) 
ways It is an *v«ii man dengaroui end »ubtle (i?), , th«» war, 
•Inc. it l» QH) eeenebi. to orifanixoJ control. Th. population 
throat Mist be feced -- Ilk* th* nuclear threet -- for what U 
inevitebly It: • centr.l d.t.»ln»nt of nenklnd'. futur.. 
one rtMpiirlng f*r »oro ettontlon then it i» preeently 
receiving. 
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m*± TEXTS RANKED ACCOKDINC TO FU3SCI READING BASE READABILITT FORMULA 



0 « original version 
R « reordered version 



Reading Ease « 206.835 - .846 wl - 1.015 si 

wl = word l-jogth 
si » sentence length 



TEXT 



VERS I 0 I 



46.9 47.8 
52.5 46.1 



origiTm1 - grammatical Terainn le xical Teraion 

1 52.9 54.5 52.0 

2 43.6 47.7 56#2 

3 57.9 54.5 46.9 5 £.0 57.9 
* 59.6 67.2 59.6 66.4 54.6 

5 " 65 « 6 70.7 55.4 49.6 

6 " 51.2 53.9 38.5 40.2 

(The higher the score, the more difficult the text.) 
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ITERS Or GRAMMATICAL AW) LPCICAL COHKSIOW Cf ORIQIKAL AHD ^jfttfCOTEXTS t-4. 197S-6Q 

(Figures represent mabtr and proportion of iteae in each tost) 

FEATURES Of TKXJ 



COHESION 


J 




_2_ 














Craautlcal 


R 


0 


JBL 


0 




0 


0-*~» L 


1 


not 7 — 
dona .01 


3 

.01 


8 

.02 




6 

.01 


32 
.05 




13 
.02 


62 — 
.08 


2 


9 1 
•02 .00 


6 

.oe 


9 

.02 


2 

.00 


18 

.03 


23 
.04 


2 

.00 


18 
.02 


19 — 

:o3 


3 


6 — 
•01 


2 

.00 


4 

.01 




2 

.00 


1 

.00 






5 — 
.01 


4 




2 

.00 


4 

.01 







1 

.00 


— 


2 

.00 


2 — 
.00 


5 












.00 








6 


— 1 

> .00 


1 

.00 


1 

.00 


1 

.00 


-— 


1 

.00 


— 




_ — 


Iff 

7 






- 


— 


m 

y 

.00 


3 

.00 


— 






Q 

o 


.00 








.00 






.00 


9 9 

.00 .00 


total t 


23 2 
.04 .00 


i7~ 

#0? 


24 

.05 


3 

.00 


30 
.04 


62 
.09 


♦00 


35 
.04 


50 e 

.12 .00 


Lexical 




















9 


2 6 
.00 .01 


13 
.03 


7 

.02 


17 
.04 


45 
.07 


12 

.oe 


39 
.06 


44 

.06 


25 40 
.03 .05 


10 


9 14 

.02 .01 


11 

.03 


4 

.01 


24 
.05 


4 

.01 


5 

.01 


21 
.03 


2 

.00 


5 4 
.01 .01 


1 1 

1 1 


— 2 
.00 


3 

.01 


3 

.01 


4 

-.01 


1 

.00 


1 

.00 


12 

.oe 


1 

.00 


— 1 

.00 


IX 
total t 


2 4 

.00 .01 
13 26 
.02 .05 


27 
.07 


14 
.04 


45 

.10 


50 
.08 


18 

.03 


72 
ill 


47 
.06 


.00 

30 47 
.04 .06 


Oth»t 


454 484 
.94 .95 


585 
.90 


375 
.90 


33» 
.90 


580 
.88 


532 
.83 


574 
.89 


691 
.90 


6J8 704 
.84 .94 


TOTAL 
NUMBER 

WORDS f 510 


1.00 1.00 
490 512 i 


1.00 
126 


1.00 
413 


1.00 
446 


1.00 
660 


1.00 
612 


1.00 
648 


1.00 
773 


1.00 1.00" 
758 753 



KBTi 0 - Original ▼«*!<» Ot 1 - raptttion 5 - w* sub»t. It 9 - rajwtitic* 
If * twitrU Tsralon 2 - iwfcrtne. 6 - clauM wbst. /# - ■ynonjM 

I m Lexical o'ohMion 3 - dwonatntlTM 7 - •lllpais 1/ - superordinat* 

G • OnMMtlesl Cohaaic 4 - noua Mbat. 8 - extra-taxtiuJ u - gtmml «onH 



ml Biic. t raluaa' O/C Ta«t 3. OA Twt 1 ttit 2 Tatrt 3 (for all other pairs, n.».) .....j *Q| C - 
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FUTURES OF 
COiiUSION 


TOTAL NIHBKfl OF ITBfiS PER FEATURE 


TOTAL NUMBER OP 

QUESTIONS PER KATURE • 












Grammatical 




c / 






1 


22 


119 




34 


• 2 


42 


OU 




41 


3 


4 


lo 




24 


4 


4 


7 




3 


5 




i 




o 
c 


6 


1 


2 


2 


3 


7 


3 


3 






8 


3 


3 


2 


1 


total: 
(proportion) 


79 

.03 


20] 

.09 


9 

.00 




Lexical 
9 


102 


4o 


102 


46 


10 


17 


23 


63 


30 


n 


5 


4 


19 


10 






2 


6 


3 


total: 
(proportion) 
«* — , 


124 

•05 


75 

o03 


190 

.08 




Other 
(proportion) 


16% 

•92 


1997 

.88 


2160 

.92 




TOTAL 

NJKfaER 

VOHUJ: 

(proportion) 

4 . 


*369 
1.00 


2273 
1.00 


2359 
1.00 





• There is overlapping of questions. Soae questions Include sections of text containing 
more than one item (and feature) of cohesion* 

27 5 atSl CUV1 AVAILABLE 



0 

ERIC 



APPKNDOC C TABLE 3 267 

rajHS OK GRAMMATICAL AND LEXICAL COHESION IK ORICIMAL AND KKORDlflUfl) TUT?; 5-6 (19301902) 



(Figures represent nuaber and proportion of itetaa in each toxt.) 
TKXT 5 yKXT 6 



FriATUUSS OF 
CUW3I0M 



TOTAL nwbar 
of question* 
pe r feature J» 



Gnimjuatical 


00, 


J3u 








J3u JBSL JSL. 


JL 


JL 


1 -repetition 


3 

.01 


** • 


4 

.01 




2 

.01 




2 

.00 


am 


6 


6 


2-rofcmnce 


13 
•02 


1 

•00 


9 

•02 


1 

.00 


14 

.02 




12 
.02 




23 


20 


3-d emoaatra Uvea 4 
.01 


1 

•00 


5 

.01 


4 

.01 


5 

.01 


2 

.005 


6 

.01 


2 

.005 


11 


14 


4~noun oubtit. 










4 

.01 


- 


3 

.01 




3 


3 


5-verb oubBt. 






1 

.00 


m 


1 

.00 


- 


1 


- 


4 


3 


6-claiiee aubot. 2 

.00 


- 


3 

.00 


m 


1 

.00 


- 


.00 




2 


6 


7-ellips3LB 


14 

.03 


2 

.005 


14 
.03 


1 

.00 


6 

.01 




4 

•01 


m 


19 


24 


B- extra- textual - 


2 

.005 


- 


1 

.00 


1 

.00 


2 

.005 


1 

.00 


2 

.005 


5 


3 


TOTAL: 


36 
.07 


6 

.01 


36 
.07 


7 

.01 


34 
.06 


4 

.01 


30 
.05 


4 

•01 


73 


79 


Lox1 ral 






















9-ropetition 


21 
.04 


. 15 
•02 


22 
.04 


12 
•02 


32 
.06 


18 
.03 


27 
.05 


11 
•02 


24 


23 


lO-oynonyma 


2 

.00 


57 
.09 


2 

.00 


49 

.09 


e 

.01 


.04 


O 

o 

.01 


.04 


40 


32 


1 1-cuporard. 




1 

.00 




1 

•00 


7 

.00 


2 

.00 


1 

.00 


4 

.01 


7 


9 


1X-j;eneral 
wonio 




2 

.01 




4 

.01 


2 

.00 


4 

.01 


3 

.00 


3 

.01 


9 


11 


TOTAL: 


23 
.04 


75 
• 12 


24 

.04 


66 


43 
.07 


51 
.08 


39 
.07 


47 
.0* 


00 


75 


Other: 


470 

.09 


53* 

•«7 


469 
.09 


531 
.08 


493 
.07 


582 
.91 


497 
.88 


582 
.92 






TOTAL: 


529 
1.00 


613 
1.00 


sw 

1.00 


604 
1.00 


570 
1.00 


637 
1.00 


566 
l.'JO 


633 
1.00 







significant t values: L/C Teat 5 IW, 1982 feat 6 1901 

0/11 Toat 5 1902 | Test 6 1961m 1962 

•Thoro in overlapping of quontlona. Some quoutiona include aootiona of toxt containing 
more titan one item (and feature) of cohesion. all Alt ARl r 
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KEY TO MORDKit.-a) SlilMCKS (Reordered Coherence) 

.TEXT 1 TJ-I1T 2 

original doctored original doctored 

coherence coherence, para/q-afth coherence coheren ce pararrar> 



1 

2 
3 

4" 

5 

7 

8 
a 

10 

11 

12 
13 
14 
15 

If, 
1'/-. 

1'' 
19 

20 
21 
22 
23 
24 



18 
19 

20 
0 

1 



4 
2 
24 



21 

22 
23 



12 
14 
13 

V> 
16 
9 

10 



■3 

f> 
',' 
11 

17 



5 



1 

2 



5 
6 
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(19) 27 " f example 3 

(25) 28 vriter f e conclusion 

(26) 29 solution 
(23) 30 amplification 



* Reordered sentence 



writer's 
solution 
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Only one solution . . 
is poaaible in the 
10-20 year broathing 
apells to fairly 
distribute wealth and ^ 
create a single 1? !q 
•middle* class. 1 

19 



ganeral questions 20 



BEST COPY AVAILABLE 
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TABLE 10 
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DIUC0U21GH ANALYSIS 



ynr.u'ranh mm Unco oontonco function 



1 general statement 

2 amplification, 

classification 

3 * , maul t/cont rest 



TEST 6 (Original) 



paragraph-level paragraph-level 

Jliocutiomirv force fiojfiejft|| 



description of 
situation 



2000-year life 
span from cultural 
development to 
decadence 



1 



4 questions 1 t 2/oauses questions causes 

, w # of final result 

5 questions % 4/ ■ 

6 restatement, result 

7 * t description 

8 reault 



Decadence of one 
civilisation 
alternates with 
ascendancy of 
another* 



9 
10 
11 
12 
13 
14 



15 
16 
17 
18 
19 
20 



21 
22 

23 
24 
25 
26 

27 
20 
29 



writers observation anmier/explanation 

^ for process 

amplification 

cauao/effect 

aaplification of effect 

writer's consent on " 

• f main argiaent, 

contrast, compefcisoo, 
qualification 

wrltor's consent, contrast * 

result 

oiplanation 

amplification 

m t cauao/effect 1 

* , cauue/effoct 2, 
definition 

examples, contrast examples 

writer's contradictory 
opinion 

cause/effect, explanation 

example 1 

example 2 

exaaple 3 

question 

answer, restatement 
restatement 



Cast and Veet — 
consecutive phases 
of dominance and 
decadence 



hostility and 
resentment of 
subjugated peoples 



6 
7 



paradox I revolt 11 
leads to dominance Q 

12 
9 

10 



J2 
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^>K:fIDIX C TABLE 10 - 2 - 

DISCOURSE ANALYSIS — TEST 6 (Original) — cont'd 
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^m^^rapfr sentence sentence fupction 



pa raw* ph-level paragraph-level 
illocutlonarv force concepts QUSIMOW 



30 

31 

32 

33 
34 

35 



general stateaetit, solution, lee son to Civilitation 



writer's opinion, 
contrast 



be learned 



clarification 
cause/effect, contract, 
rostateoent, explanation 
alternative 

alternative 2, contract p 
cause/effect 

result 



needs conflict/ 
friction in order 
to develop* 



13 

14 

15 

16 
17 
18 
19 



general question: 20 



ERLC 
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AJTKHDDC C 

DISCOUHSB AHattSIS 



TABLE 10 - 3 - 287 
— ttST 6 (Reordered) 



(original) 
l ira/»rtu>h /pontcnca sentence function 



(30) 1 

(31) 2 

(33) 3 

(34) 4 

(32) 5 

(35) 6 

(2) 7 

(6) 0 
(5) 9 

(7) 10 

(3) 11 

(4) 12 



central statement, 
contrast 

clarification 

Alternative 1 

alternative 2, contrast, 
cause/effect, definition 

restatement, contrast, 
cause/effect, explanation 

reault 



pimcraph-level 
lllnrutionarv force 

description of 
eituation 



General statement, 
classification 



questions caucee 
of result 



result 

questions 1 , 2 (oauses) 
description of result 
**ault, contrast 
questions 3» 4 (oauses) 



paracraeh-l«vel 



Civilisation needs 
conflict/friction 
to develop* 



ill societies end 
in decadence. Why? 



QUSSTIOW 
1 

« 

2 
3 
* 

5 

6 

(6) 



(21) 


13 


oxampleox iaerlca, Kuuaie, ec 


UBpl 




contrast 




(22) 


14 


writer's opinion, cement 




(2C) 


15 


exaaple 1 




(25) 


16 


exsnpla 2 




(24) 


17 


exaaple 3 




(23) 


1U 


Cftuoo/offoct, explanation 




(27) 


19 


question 





exaaples of aodern 
conflict reinforce 
theory 



10 

8 
7 

11 



(11) 20 
(8) 21 

(12) 22 

(13) 23 
(H> 24 



cause/effect 
• f process 



aaplifi cation of effect 

writer's cosnent on * 

* , comparison/contrast, 
writer 1 s sain arguaent 



answer, expla- Decline creates 
nation for process vacuus, into which 
another nation 
can enter* 



12 
13 



(1)25 
(9) 26 

(10) 27 



exasples 
■ , amplification / 



writer's observation 



« « 



East and Vost — 
-onaecutive phases 
of dominance and 
decadence 



14 



ERiC 
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./2 



DISCOURSE AMUSES 
(original) 

juaraufa /mtom ****** 



nag m -4- 2» 

— tiBT« (taoxtlaiad) — ooat'd 
para/n*ph~ltYal paj*cniph~la*al 



(t5) 2a 

(19) 29 
(17) 30 
(1B) 31 

(20) 32 
(16) 33 

(2a) 34 

(29) 35 



at, daacriptlon of raault hostility and 

raaantaant of 
subjugatad 
paoploa 



vritar'a oc 
ooAtraat aaanfiaa 

cauaa/affaot 1 

afspllfloatlOA 

H 

■ , cauat/af fact 2 

• » raaaon, raatataaant 

of caim/affect* 
procasa 

a a 

» 

a a 



15 

16 
17 



16 
19 



emend quaotlont 20 



BEST COPY AVAILABLE 



APPENDIX C 

TABLES 11-15 COHESIVE CHAIRS 
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DESCRIPTION OP CHART 

Horizontal axis (b ottom) : sentence and paragraph numbers 

from text 

Vertical axis : Referents (nouns and noun phrases) 

Each noun or noun phrase that is linked cohesively 
(doctored and non-doctored alike) appears to the left of 

the vertical axis. 

On the axis itself, next to each ncun or phrase, 
each of the three versions is indicated: 

0 — Original Version 

0 — Grammatical Version 

L — Lexical Version 
To the right of each noun phrase, brackets enclose the 
sentences containing it. 

Errors in doctoring are indicated by O . 

Changes of sentence structure are indicated by ® . 

Horizontal axis (top): Questions and Easiness Indices 

Por cro»s-ref*renoe purposes, the Question pertaining 
to a particular sentence and/or paragraph is indicate* along 
the top of the graph — along with the Easiness Induex for 
each test version, less effective question* (those having 
a Discrimination Ind'.ex of less than .50) are indicated 
by a - ♦ " . General questions which pertain to the text 
as a whole f&fef nain idea} are listed to the right cf 
the chart. 
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fOLLOVTO MB CHART; M JSUBjA* °* ** at 2 
V* bogin roadlag tho chart froa tho lowor loft. Th«rt it 
oao cohoairo ohala, ooataiaiag tht phraaa "world populatioa 
growth" — whloh ohmgta ia tho toxt to "thraat." Thia ohala 
btglaa ia tht flrat aoatoaoo «ad coatlauoa oa through aoatoaoo 6, 
which la tht tad of tht ttr§$ paragraph. Ia tht aoccad paragraph, 
it raappaara ia aaatoaeo 9» aad thta diaappaara uatil th« vary 
laat aaataaoo, ao. 22. 

Duriag thia tiao othar oohoalwt chaiaa alao aa*a thtir 
appaaraaoa aad diaappatraaot alaag tho chart. Bach appaaraaoa 
of a ohala la aotod, whothar or aot aay doctariag hat takaa 
plaoa. Wt att that tha fir at 5 apptaraaoaa of thia phraaa art 
aot ia fact dootorod, but raaaia idaatioal la font through all 
3 woraioaa. Haaoa tht arrow dtwawarda frta "0" to "0" tt "I". 

Ia the toxt, tht origiaal phraaa "world populatioa growth" 
(liaa 1) btooaaa "it" (liat 2), "a oubjtct" (liaa 2), "their 
populatioa iaoroatt" (liat 3), "Populatiaa growth" (liat 5)t «*d 
"tht gravtat It tut" (liaa 6). 

Tht tlxth auabtr (atattaot 4), graaaatlcal rtftrtact (2), 
ia tht aaaa la tht origiaal aad grwaatical vereiont but ia 
dootorad tt a lazical ayaaaya (10) ia tht ltxloal woraloa. 
Ia tha origiaal raraita, "it" (liat 8) s la tht graaaatloal 
Ytraiaa, "it" (liaa 7) 8 ia tha laxical varalaa, "aa iaortaat 
la tha world'* populatioa." (llao 7). 

Tho aoxt itoa, "throat," a loxioal auparordiaata (11), 
alia raaalaa uadootortd. Ihoa a rtpotitioa of tht prtctdiag 
patttra ( 2 to 1C). Aad thoa thort followa a diffaraat faatura 
ia aaoh af tht 3 Ttralaaa for tho followlag itoa la aoatoaoo 5 — 
la tho origiaal raraita, graaaatloal rapotitioa (1); ia tha 
ERIC * PIUM,t * i0,d w »*«»» ** oalttod alttgtthtr, rooultiag la a 
h ~ M ohaagt ia atattaot atructaro (13 (§); aad ia tha laxical woraloa, 



DESCRIPTION (oont'd) 



APPENDIX C 
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4 




A hM bm used (12). In the original version "It" (11a* 10) i 
In the grammatical version tha two sentences art ooablaad aad 
•'the itaa oalttad altogether; In the noun version, "The problem" 
(line 9). 

Thle preoeee la repeated all through the chart far each text. 

On the top horizontal axle are the test questions, 
directly above the sentences te which they pertain, aad tha 
Easiness Index for each of the 3 Torsions of text* 

The questions renala ldeatloal for each teat rersloa. A 
differenoa In Easlaess Iadex van expected te reflect tha relative 
ease or difficulty af a particular seotlen of text er text version. 

Interestingly enough, the Dlsorlalnatlon Index varied aa 
well. On Test 2, Question 5, for example, Is effective in the 
original and lexical versloas but jielde a lev Diacrinination 
Index (less than .30) in the grammatical version. The reverse, 
however, is true of Question 6, which is effective in the 
original and grammatical verelons but not in the lexical version. 
The only queetion having a lev Discrimination Index in both 
versions (i.e., not an effective question at all) is Question 20, 
a general whole-text question which can be found to the right 
of the sentences. 
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TABI£ 11 — C (EES ITS CHlDBi Graphic Chart of CoheaiYa Iteae across 3 rtrsioaa of text, coaparisoa of results of tost question* 



APPENDIX C 

Orifiaal rsrsioavteasiaeea ladex 
Crwaatioel rersioevteasiaess ladax 
Lexieul yeraioa/Ualnees lades 
OIESTICM XQKHSt 

direct legal' liaitatioaa 
coercion 
gorexmeata 
laereasa ia iaccm 



TBST2 

79 46 87 74*51 74 58 58 
65 45 79 65 72*84 31 50 
6J 67 91 80 83 75*64 67 
1 1 2 3 4 5 6 7 8 



87* 
68 
71 
9 



RSFSRSJTIS 

(Nouas tad ffoua 
Fhraaet) 



feailiee 



iaereaae ia educatio* 



woaea 



3' 1 



threat of vorld populetioa growth 

aeatence mother t 
paragrsph rnabert 



0 
0 
L 
0 
0 
L 
0 

a 

L 

0 
G 
L 
0 
G 
L 
0 
G 
L 
0 
G 
L 
0 

c£ 
H 
t 



ii 



to 



i 



9 u 



in; 



i 

K a 



82 94*42«76 76 97«6l 82* 
75 # 90 # 46 75 67 81 45 ^ 
92 91 39 75 62«87«55* 87 
10 11 12 13 14 15 16 17 

' N 



r 



t ? 



i | 
j i 



t 
t 



! 1 



to 3 



t I : ( o|;|4.;ii3 
C i <£*,H iiifl 



VP 

'4& 



an 



! 



1 1 



3 4 5 6" 7. 8 9 



10 11 12 13 H 15 16 17 18 19 20 21 

3 V ~£~' V " 



22 



* - Sasineee Index* » 



lov DieeriainatioB Index (lese then .30) 



1 



58*51 64 
67 70 40* 
71*51*50* 
18 19 20 

General queetioaa 



I 0 * 39 students 
Iq » 45 students 
1^ * 56 students 



t test: p ^ *01 



* a 



392 
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BEST COPY- AVAILABLE 



BEST COPY AVAILABLE 



«« » - c^m mm. ,~m< „ c«..i„ ■«.. «„.. , „„ too , „ tet , eat ^. oa „ „ Iul „ of „„ 

Original Tersiony^asiness Index 53 
Gramaatical version/Easiness Index 45 



TEST ? 



lexical vers! on/teas inees Index 
QUESTION NtKBER 

* person 9 * reaction 



100* 


38 76 84« 


84 


30 76 84 # 


95* 


45 55 54 


27» 


27 58*84 


97 # 


60 78 59 


64 


40 58 87 


2 


H 3 4 


5 


15 16 6 



81*84 38* 53*69 
81 90 27* 75 46 
85*91 24 61 58 



92 
60 
63 
11 



53 
72 
80* 
10' 



53* 84 92 84 
45 84 83 78* 
56 73 85* 90 
12 13 19 20 
General questions 



1EFERQQS 

(ftouna and Bout 
Rinses) 



the shift 
experience! 



axafgarated laughter 0 ] 
0 



lnaghinji 

(3 inportaat) vajn 

appreciation of the conic 

erejjone 
(people) 

honor 

sentenca nunber: 
4^ n ^ paragraph nunber: 

a - Easi »ss Index* » lav Diseriain*tion Index (lass than .30) 

3 ccA^j/^t cAa"»H 
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BEST COPY AvAiLMdu 



TABLE 1 5 COHECIVE CHAIK?: Grajhic Chart of Cohesive Items Across 3 versions of text, comparison of 

at?:'.:: !>'■ C 



results of test questions 



Original Tersicnyfensiness Index 
Graasatical ▼ersion/Sfcsiness Index 

Lexical tersi on/Easiness Index 
QPSSTICK ROGER 
equal distribute* of money 



TEST 4 



BEFH21SNTS 

(louns add Noun 
Phrases) 



people 
conditiom 
the elderly 
adults 
(the) »eed 
the young adult 
a Jo* 

sentence ntaber s 
paragraph ambers 



a 

G r 
I 
0 
G 
X» 
0 
G 
L 
0 

a 

L 
0 
G 
1 
0 
G 
I 
0 
G 
L 



67 


83 


61 • 


79 


77 


(75) . 


33 71« 


37 


75 


68 


98 


48 


88* 


92* 


(75) 


♦3 70 


48 


75 


78 


97 


28 


88 


97 # 


(83) 


28 83 


47 


83 


2 

1 


« 

i 


H 


3 


4- 


(6) 


15 5 


7 


6 



45 

50 

69* 
8 



39 65*51 • 47 91 69 57 53*53 83 
41 70 66* 48 92 77 # 37 28*57 83 
88*78 66 47*90*64*65 35*66 80 
16 17 18 9 19 U 20 10 12 13 



questions 





I 




1 

1 

J 




i 




























j 










fa 


^ 


1 




1 

1 
j 

It' 


i 

"1 








! 












i 
i 
» 




















i 








: 1 

■ 


HI 

in 




u 

4 

1 


u 


a 










— i 

1 












i 

i 
























>: 
'M 








- 
































i 




















( 


: 


M 
3 ; 
io; 






































i 
















i 


in 

»n, 
H 


M J 


) 










































I 

i 












3 
1 












3. 
3! 
1 ' 

■ 






































i 
i 






to 






































.... 




















1 


4 


u 3 . 

HI 


b 




i « 






y 































50 students 
54 students 
1 42 students 



t test: 

not significant 




10 



* — Easiness Index* « low Discrimination Index (less than .30) 



30! 
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BEST COPY AVAILAbLt 



21& 13 — COHESIVE CKADJS T£3T 4 (cont'd) 



Kr'^:.ZJ>. C 



the adoleaceut 



his fricnde 



material poas«8«iott» 



HEF2R2?TS 

(louas and Houa 
Phrtwfl) 



* Child 



sane and 



tha / 



* paraoa 



aomey 



•amtenca sab«r I 
paragraph ambers 




1 1 : 

I ! ! 

I.I' 



a ;i ^Mi^j 1 TTJjt^ SIS 

i *l ! ail j hp i ; / ! Hiiji ;i@| 

. . . jjjj Aw liviiiiii^g ; 

2 * >l_LJ-3vl-2 10 11 12 13 14 15 16 ^Ug™ 20 JL^23 24 25 26 27 28 29 30 31 



ilia's 



l] 
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3 ceAaii^t c/.f4*,r\ 



338 



APPENDIX C 



TABLE U 



296 



HIERARCHY of EASINESS INDICES of Questions related to sections of text 
containing cohesive itoma ( Texrs /» «/ ) 



GRAMMATICAL COHESION 



LEXICAL COHESION 



Mean Easiness nimber of number of Mean Easiness 

Feature Index questions students Featufq Index 



8— extra-text. 67.88 $> 



4 
3 
2 

1 

7 
5 
6 



nwoubst. 
demonst. 
reference 

repetition 
ellipsis 
v. subst. 
cl. nubst. 



65.65 fo 
65.56 £ 
64.01 £ 

61.40 £ 
59.63 f° 
50.45 
47.98 £ 



20 



28 

63 
68 

61 
29 
10 
4 



923 



10 - syn. 67.69 # 

9 - rep. 66.31 # 

12 - gen. 

words 65.96 # 



11 - super. 60.45 # 



number of ma:' ar c 
question studentc 



91 
95 

19 



43 



1004 



total: 



3*3 



J Hi 



(TEXTS 5-6) 





60,61 $ 


36 


873 








— 


60.15 e i° 


21 












59.31 # 


24 




11 -■ 

12 - 


59.12 fo 
58.96 ?6 


48 
60 


i - 


56.98 °j° 


129 










— 


56.94 c ,° 


24 




10 - 


52.77 # 


186 


7 - 


52.50 


129 










3 - 


52.33/* 


75 




9 - 


52.30 # 


141 


4 - 


47.72 5* 


18 












total: 


456 








435 
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TABLE IS HKPULTS OF M-C COMPREHENSION TESTS 1 - 4 ( 1978 - 1980) — COHESION 



TEST 



2 0 



2 G 



2 L 



3 0 



3 G 



3 L 



4 0 



4 G 



4 L 



Original vs. Doctored for Cohesion 



N (students) 40 
Mean (£>) 
SD 

N 224 
Mean (#) 
3D 

N ( 253 
Mean (#) 



N 

Mean (#) 
SD 

N 

Moan (?.'•) 
3D 

H 

Mean ('/Q 

:jd 

N 

Mean ( f / ; ) 

:>D 
H 

Mean (#) 
SD 

N 

Mean &) 
SD 



68.85 
17.53 



65.15 
15.33 



68.55 
14.62 



29 



67.25 
17.94 



244 



59.61 
21.57 



350 



64.87 
18.34 



66 



59.55 
16.28 



201 



267 



59.05 
20.09 

7 

59.47 
22.78 



0 = Original version 
G = Grammatical * 
L = Lexical " 



degrees of 
t (paired) value * freedom 



2.03 



.16 



1.12 



.12 



1.66 



1.42 



19 



19 



19 



19 



19 



19 



for all 4 texts: 0 vs. G: t (paired) = .7 (13)» n.s.; P = .16 (j), n.s. 

0 vs. L: t (paired) = .15 (13)» n.s.; F = .39 (3)» n.s. 



♦All values not si gnificant. 
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CLOZE FINDINGS 



tm is 

rational cloxe 
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THIS 1 - 3 

Vereion 1 - Original 1- 186 0$ 89 

Version 2 • Reordered 97 

(df) jl _e_ iitl JS fi- Haflft ?t«rit Pn* JL 

all teete together, 0 r». 1 .4.357 .000* 1.64 .05 

origin*:"* 5 <*•"> 62.0 14.3 89 

reentered: 51.4 18.3 97 



•11 teste together: 

teat x vRftm , 7.19 .0001 



each teat separately: 

tost x version 3.95 .05 



3.95 
(2j /«) 



original vs. reordered: 

for each test separately 18.98 .0001 

(1,M"0 

Teat 1 1.152 n.». 3.00 .005 

original: (6,) <28>33) 63.3 M.3 34 

reordered: 58.3 21.4 29 

Test 2 5.07 .0001 1.09 n.». 

original, < 55) ^'^ 66.3 15.2 28 

reordered: 45.4 15.8 29 

Teet.3 1.33 ».s. 1.32 n.s. 

original: (64) iV,26) 55.8 14.1 27 

reordered: 50.7 16.2 39 

Teet 1 1*33 n.a. 

Teet 2 , 25.72 .0001 

.Teet 3 . 1.78 'ma. 

all Original vera! ana: 

each text aeparately . A* 2 * *°5 

(2 ; t<*) 

all Reordered veralonat 

each text eeparately ^ 3«® *°5 

differences I aaong texta 

original ve. reordered, especially Teat 2 (reordered nore difficult} 
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TABLE 17 ADDITIVE VS. COHTRASTIYE PARAGRAPHS 
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Palra of Questions Relating to Sentences Cor»<^ p ^ Changes in I^locutionarv Force 



TEXT TOTAL fe) 

J £ 2 & 5 fL 

Original Additive . q / A< i 

Reordered Contrastive 1 ' 1 * * 1 w 

Original Contrastive 

Reordered Additive - - 2 1 1 - 4 (3 

Specific tjuentiorus 

Common to Doth Versions 11 10 15 15 9 9 69 (57?0 
Whole-Text 'jucnlions 

Common to Doth Versions 9 10 2 1 9 7 38 (32#) 



TOTAL: 120 (10C£) 
quentions 
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APPENDIX C 500 
TABLEJf RESULTS OP M-C OTJESTIOHS ON TEXTS DOCTORED FOR GRAMMATICAL AND 
LEXICAL PfflESTflir 

' (students) 

TET3- ; C0HESI0N 1L Meag SD Wue (df) F-ralue {^1 ju 

Kid-tera G 221 62.9 19.9 1.55 (439) n.s. 2.40 (440) n.s. 
~ 4 *» 220 65.9 20.7 



5 - 6 



1 - 6 



4 
4 



(1978) 
(1979) 
(1980) 

5-6 

5-6 
(1980) 

(1981) 

(1982) 

1 - 6 

(1980) 

1 

2 
3 
A 



5 



9 

ERLC 



G 
L 

G 
L 

g/l 
gA 

g/l 

gA 

gA 
g/l 

g/l 
gA 

gA 



G 
L 

G 
L 

G 
L 

B 

L 

G 
L 

G 
L 



259 52.8 18.0 



479 58.8 20.0 



61 67.6 21.0 

60 70.4 23.3 

54 65.1 • 15.6 

54 68.5 14.4 

53 58.9 21.0 

53 64.3 18.6 

53 59.7 23.5 

53 59.1 20.4 

120 54.3 20.4 

119 53.9 19.3 

138 51.4 15.5 

140 51.8 15.2 



.02 


(515) 


TUB* 


.00 


(516) 


n.s. 


1.07 


(956) 


TUB* 


1.15 


(957) 


n.s. 


1.18 


(22) 
















3.78 


(135) 


.05 












U.S. 








.04 


(151) 


n.8. 


.82 


(22) 


a.s. 














.35 


(157) 


n.s. 








.56 


(199) 


n.s. 








.01 


(158) 


n.s. 








.06 


(309) 


n.s. 


.70 - 


(119) 


n.s. 


.49 


(120) 


n.s. 


1.18 


(106). 


n.s. 


1.39 


dot) 


n.8. 


1.40 


(104) 


n.s. 


1.91 


(105) 


n.8. 


.12 


(104) 


n.s. 


.02 


(105) 


n.s. 


.16 


(237) 


n.s. 


.03 


(238) 


n.8* 


.23 


(276) 


n.s. 


.05 


(277) 


n.8. 



* Mentions where F-test vas significant (p « .05). 313 



13, 14 

, 3, 5, 6 
10, 11 ' 



13, 14, 17, t 

20 
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TABLB COHERENCE - RESULTS OP M-C QUESTIONS ON ORIGINAL AND ^REORDERED 
VERSIONS OF TEXT 

0 « Original 
R « Reordered 

(students) 

TBSTC COHERENCE N Mean SD Walue (df) ?. va i ue fcf) ^ 

Kid-term 0 289 65.2 20.3 1.15 (439) n.s. 1.32 (440) n.s. 

R 152 62,9 20.2 

5 - 6 0 278 54.3 17.1 2.17 (515) n.s. 4.70 (516) .05 
R 239 51.0 18.0 

1 " 6 0 567 59.9 19.6 3.31 (956) .001 10.95 (957) .001 
■ R 391 55.6 15.7 

1-J 0/R .83 (22) n.s. 

5" 6 x , 2 «37 (22) .05 

(1980) °/ R 1.77. (157) n.s. 

(1981) °/ R 1.50 (199) n.s. 

(1982) °/ R 15.54 (158) .0005 

1 - 6 

(1980 > °/ R 1.92 (309) n.s. 



* 



1 0 81 67.8 24.0 .84 (l19) n.s. .71 (120) n.s. 5, 9, 11, 18 
R 40 71.4 17.7 

2 0 72 68.0 15.0 1.10 ,(l06) n.s. 1.20 (107) n.s. 20 
R 36 64.6 15.0 

3 0 70 64.1 18.7 1.81 (104) n.s. 3.27 (l05) n.s. 1, 2, 6, 8, %t 
R 36 56.8 21.5 13, 14 

4 0 66 60.1 21.5 .45 (l04) n.s. .20 (105) n.s* 3, 5, 6, 10, 

R 40 58.2 22.7 12 , 14, 15, 19 

5 0 119 56.4 19.9 1.74 (237) n.s. 3.04 (238) n.s. 1, 2, 3, 4, 6* i 
R I 20 51.9 19.5 7, 10, 13, 14, 16,/ 

6 0 159 52.8 14.5 1.49 (276) n.s. 2.23 (277) n.s. 2, 5, 7, ' -r 
R 119 50.0 16.2 9f 15 ■':•> 



38 questlone 



ERXC Quec ' tions wherR F ~ test was significant (p * .05). 3-^4 
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TABLE 19a Cohesion vs. Coherent ' 
Tiro-Way AIJOVA: Least Square Ifeans 

COHESION 





Lexical 


Grammatical 




COSERHTCS: OniyNal 


61 


58 


59.7 


Reordered 


56 


55 


55.6 




58.4 


56.9 





n = 567 
n = 391 
N = 958 



F (cohesion vs. coherence) = 4.17; df = 3, 954 
F (cohesion) = 1.33; df = 1 

F (interaction) = .57; df = 1 



ATl'KHDIX C 



tabu: 20 
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KAWillHC TKIiT wUK::TIWB Witt LBCICAL AND 0H4WATICAL MM OF C0HBSI0JI IM TrfK TUCT« 

■n.y. T 1 (jcpR. 1<rW. 1<X») 
uU^mfwi TYkR 01-' CMKmO* Dj KAOj 'l^iT VKlKIOIf (0 - OririBftl, R - Reord.wd) 



1 



2 2 



2 2, 8 2, 8 

b 3 3 

6 3 3 

7 3 3 

8 1 2 

9 1 1 

10 3 3 

11 1 1 

12 1 1 

13 3 3 



10 


10 


10 


9 


11 


11 


11 


11 


9 


9 


10 


9 


10 


10 


9 


9 


9 


10 


9 


9 


10 


10 


11 


11 



TYPK OK CflKSKM 

rarr » t UK::Tii»?r« 

oc (^78=1979) JL 

grammatical 

1 - .repetition U, 9. 11. 12 4 

2- roference 1 f 2 2 
><iemonstrativee 3, 5» 6, 7» 10, 13 6 
4 -noun eubsW - 

'j-vurb eubnt. - ~ 

l>-clauao subut. — * 

7-ellipoi» 
tJ-extra- textual 2 



2 



totals 

-~ - QLTlQ : /?lSl979r 
loxical 

^repetition 6, % 10, 11 4 

10- uynoivyaa 1# 2» 7# 8» 12 5 

11- euporordiraitee 3» b» 13 5 

U'-gunerul words - ~ 

totals 12 



RC ( 1900) JL 

9, It. 12 3 

1. 2, 8 3 

3, 5. 6, 7. 10, 13 6 



total t 



KL U9fl0l" 
2, 6, 7, 9, " 
1, 8, 10, 12 
}, 5, 13 



1 

IT 



5 
4 

3 



totals 12 




Jiu/wimry: same quostiona 

0/R different questions, saae^nuSoer of question* 

Implication: Chancing the order of the sentences changes type of cohesion aa 
well as coherence* 

.3JLS BEST COPY AVAILABLE 



APP1U.DIX C TABLE 2\ 303 

MATCHING TEST QUESTIONS WITH LEXICAL AMD GRAMMATICAL ITEMS OF COHESION IN THE TEXT* 

TEST 2 (1978, 1979, 1980) 
,<flESTIQN TYPE OF COHESION a EACH TEST VERSIOM (0 - Orltfnml, R - Reordered) 

oo tuaaaaa) rq Ore) ql t^a. ^ rl dgao) 



1 2 






3 


9, 


10 ^10 




2 4 






3 


9, 


10, 11 10 




5 1, 4, 


7 




1 


9, 


10, 11 9, 


10, 12 


6 1, 7 






7 


11 




10, 


12 


7 1, 4 






1 


9, 


1! 


s. 


11, 12 


8 2 






1 


9, 


10 


, 11 11 




10 2, 5 






2, 5 


9, 


10 


10 




11 3, 5, 


6 




3, 7 


9, 


10 


9, 


10 


16 2, 3, 


4 




3 


9, 


10 


9, 


10 


17 2, 3, 


4 




1 


9, 


10 


9, 


12 


• TYPE OP COHESION 














TEiJT (MENTIONS 












grammatical 


OG 


(1970-197?) 


N 






JL 


1 -repetition 


5, 


6, 7 




3 




5, 7, 8, 17 


4 


2-referencs 


1. 


8, 10, 16, 17 


5 




10 


1 


^-demonstratives 


11. 


, 16, 


17 


3 




1, 2, 11, 16 


4 


4-noun subst. 


2, 


4, 5 


, 7, 16, 17 


6 








5-verb subst. 


10, 


11 




2 




10 


1 


6- clause subst. 


11 






1 








7-ellipsis 


5, 


6 




2 




6, 11 


2 


8->extra-textual 






















totalt 


22 




total t 


12 



lexical 
9-repetition 



QL (1973-197?) 



JL (1980) 



It 2, 5, 7, 8, 10, 11, 16, 17 9 

10- Bynony«B 1, 2, 5, 8, 10, 11, 16, 17 8 

11- superordinates 2, 3, 6, 7, 8 5 

12- general words - «. 



total I 



22 



5, 7, 11, 16, 17 5 

It 2, 5, 6, 10, 11, 16 7 

7, 8 2 

5, 6, 7, 17 4 

total. 18 



ERLC 



Summary: C/L same questions 

O/ft different questions, different total number of questions (fewer in R) 

Implication: Changing the order of tho sentences changes type of cohesion 
as well as coherence. 
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BEST COPY AVAiLAbu 



BEST COPY AVAILABLE 

ATPKHDIX C T41 U* 22a 304 

Matching Test Queatlona with I tea of Lexical Cohesion » 

TKST 3 1978 - 19BQ (o « Original, R » Reordered) 



QUESTION 


OL (1078) 


OL (1979) 


u 

«L (1980) 


1 


5. /a. p.li 




9.10. 0./* 


2 


- 


9.14 


10. /jL 


3 




9.1* ft. H 


9.i«.H./>. 


4 


9.10. 


1./*.0./*t 


9./«. 0.1* 


5 




j./a 




6 








7 


3 


J 


3 


8 


9./e 


9./* 


3.J0.1* 


9 




J./0.0.A 




10 




9./» 


9.10 


11 




9.10.0 


3.]0. |/ 


12 




9.10 




13 


9.10. 0 


S./0.0 


9 .10.0 


18 


1/ 


1) 


1/ 



TEST 3 - QUESTIONS 



• TYPE Of 
COHESION 



OL (1978) 



1. 3, 4, 5, 7. 
8, 10, 11, 12, 1? 



1, 3, 4, 5, 8, 

10, 11,. 12, 13- 



9- repetition 
lo — synonyms 
||- superordinates 1, 3, 4, 11, 18 
|i- general words 1, 3, 4 



91" (1979) 

1, 2, 3, 4, 5, 6 
7, 8, 9, 10, 11, 12 

1, 3, 4, 5, 6, 8, 
9, 10, 11, 12 

1, 3, 4, 9, 11, 18 
1, 2, 3, 4, 9 



& (1980) 

1, 3, 4, 5, 7, 8, 
10, 11, 13 

1, 2, 3, 4. 5, 8 
10, 11, 12, 13 

1, 3, 4, 11, 13, 18 
1, 2, 3, 4, 8 



Note: t&iestioi/no. 6 appear^ only in 1979. 

In HL vereion, paragraph no. 3 is not directly teeted by any specific 
paragraph-level question. 

Summary: Changing the order of the sentences also changes the cohesive items 
tested by the questions. 



number of pupations per ty pe of cohesion 
{0)1978 frJlgre M198Q 
12 9 



°i - 
10 - 

)l - 



totals 



10 

9 
5 
3 



10 
6 

5 

IT 



10 
6 

5 

15" 
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BEST COPY AVAILABLE 



kaiciiihc tct.t wonon wito mats ok cuawutical cciiksioh* 

j^jy 5 !'//» - 1*>0 (0 ■ original, R * Heordartd) 
ITCH.': OK CltAHKAWCAL COHKilON 





9P,Mtp % Y 


PC (lOTJ) 


M (19H0) 


i 
i 


• f .*| 


It *# *> 


t. 2. 5 


;> 




1. 2, 5 




K 

j 




2 


2 


4 


1. ? 


1. * 


1. 2 


•) 


t, 2, 5 


i ■> l . 7 


2. l >. 7 






1. 3 




7 


2. 3 


t. 3 


2, 3 


IS 


1 


?, a 


2 


9 




1. 2, 4 




to 


5. 7 


7 


7 


11 




5. H 


3. 8 


1? 


1. 2, 3 


2, 3 


1, 3 


13 


1. 2, 3 


1, 2, 3, " 


t. 2, 3, 7 



• hit-: OK 

l-i'i'i'Mititiun 
.'-rt't'tM'i'ftoo 
/-iltiui*»n:.t rativo 
4-nouii tiub:iL. 
V-vurh uubut. 
tj-clauno tiubnt. 
7-elHpnia 
jwi t rn-tof tiut! 



1, 4, », 1?, 13 
3, 4, S, 7, 12. u 

1, m, t;\ 13 



10 



(a) (l97 f jl 

1, .\ 4, % n, 7, % n 

3, 4, >, *>• B f 9, 12, 13 
1. ». 7, 11# 12, 13 

9 

1* :\ 5 



S, 10 

H, 11, 13 



1 9 2, 4, 12, 13 

1« 2, 4. 5, 7, 8, 13 

i. 7, 11. 12. 13 

1. 2, 5 



S, 10, 1*1 
| 1, 11, 13 



Kotni CAio:itiort no. fyi|.|»-hr onJy in 19/9. 

J a l«i von.lon, K «n*ffij* no. 3 i« not tinted by any Bpecific paritfra^lavel question. 

.Suttiuyt Cimtni: lt*« Mrtor «lm> cha/i*.* tw. coliniive lt<« t«t«d by tho question. 







1 


•> 


i 


1 i i> 


I 


H 






19/>l 


{> 


6 


4 


i 


1 




2fl 


OG 




Z) 


9 




1 3 


> 


3 


32 


1(0 


19»*J 




7 


i 


3 


3 


3 


?6 



ERIC 
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BEST COPY AVAILABLE 



MATCHING TEST UUK7PIONS WITH LEXICAL AND CRITICAL 2X018 V COHBSION IN TME TKXT* 
Tt.r,T 4 f tore - 1<WO) 

(gjgglON Mi Og COHESIOH tm turn TKST VERSION (0 - Ort«lMl t E - Reordered) 



1 


1. 2 




«t 2 


It 


2. 


4, 


7 | 


* 


1 




1» 


2 




2 


2 




2 


2 








1 


It 


2 


It 


2 




3 










2 


+9 


7 




1, 


2 


1, 


2 










7 






















4 


2, 3. 


4 


2, 3, 4 


1. 


2, 


3 




1 


It 


2 


2 






5 


•i 't 


O 

o 


1 2 7. 8 


• P 


2. 


7, 


8 


1 


1, 


2 


It 


2 




6 






6p 7 


6, 


7 








It 


2 


If 


2 




7 


1. 2, 


3 


2, 3, 4, 7 


If 


2, 


3. 


4, 




2, 


3 


1. 


2. 


3 












7 


















8 


1. 2, 


3. 


1,2, 3. 4, 


1. 


2, 


3, 


4, 




1. 


2. 3 


It 


2, 


3 




8 




7, 8 




7, 


8 
















9 


1. 2, 


3, 


2, 3, 4, 7 


It 


2, 

7 


3, 


4. 


1. 2 


It 


2 


It 


2. 


3 


10 






4. 7, 8 


4, 


7, 


8 






1. 


2 


1. 


2 




11 


1. 2, 


3 


1. 2, 3 


1. 


3 








2 




It 


3 




12 


2. 3, 


4, 


2, 3. 4, 7 


3. 


4, 


7 






2 




It 


2 






7 


























13 


1. 2 




1. 2 


1. 


2 






1. 2 


2, 


4 


2. 


4 





TYFK OK CUlKiilOH 

TKfl' QUESTIONS 
" . 0CT1978) 

1- gnumatical 5 , 7 , 8 , 9. H. 
repetition J2 

2- r«l'erence 1, 2, 4, 5, 7, 8, 

9, Hi 12, 13 

3- deBonotrativea 4, 7, 8, 9, Hp 

12 

4- noun sufcat. 4, 12 

5- verb mibst, — 

6- clause aubat.— 

7- ellipsis 12 

8- eitra-text. 5, 8 



OC (1979) 

1, 3. 5, 8, 11, 13 

I, 2, 3. 4, 5, 7, 
8, 9, 11, 12, 13 
4, 7, 8, 9, 11. 12 

3, 4, 7, 8, 9..10 12 



3. 5, 6, 7, 8, 9, 10,12 
5, 8. 10 



9-lcxicttl 

repetition 
1 0-Byjionyn* 



PL (1978) 

1, 2, 4, 5, 7, 8, 
9, 10, 11, 12,13 
9, 13 



11 -auperordinatea - 
12-general wordf 



PL (1979) 



1, 2, 3, 4, 5, 6, 8, 
9, 10 

2, 3, 4, 5, 6, 7, 8, 
9, 10,11, 12, 13 

3 
13 



M (1980) 

1, 3. 4, 5. 7, 8, 9. 
" II, 13 

1, 2, 3, 4, 5, 7, 8, 

9, 13 
4, 7, 8, 9, H, 12 

1, 3, 7, 8, 9, 10/2 



1, 3, 6, 7, 8, 9,10,12 
5, 8, 10 



m <1980) 



1, 2, 3t 5, 6, 7, 0, 9, 10, 
11, 12 

1, 2, 3, 4, 5, 6, 7, 8, 9, 

10, 12, 13 
7, 8, 9, 11 
4 



n-naber of oueationB ™.r type of COheflm 
J. 2 J i 1 6 2 £ TOTfit 
OC (1978) 7 10 6 2 - - 1 2 28 
OC (1979) 6 11 6 7-18 3 42 
RC (1900) 9 96 7-18 3 43 



j2.jnjj.12. 

OL (1978) 11 2 - - 13 

01 (1979) 9 12 1 1 23 

RL (1980) 11 12 4 1 28 



HMCHIM T£*T iffSHHG M» LKXICAL AND GRAHKATICAL XNB OP COHESION U W WBf 



jg3 5 QaJSa I2ib 



3 
4 

r* 
7 

10 

11 

1? 
13 
14 
IS 

10 



TYI'K OK OUIK.»IUU 


ni kacii tv:tt 


VKIUJION (0 m Original, 


H * R#orderw 
RL 

UK 


OJJ 






2 




9 10 12 




1^367 


12 3 6 7 


9 10 12 


9 10 11 12 


2 


12 67 


9 10 12 


9 10 11 12 


? '5 6 7 


12 3 6 7 


9 10 11 12 


9 10 11 12 


2 5 


12 3 7 


9 10 11 


10 11 


7 


7 


9 10 11 12 


9 10 1 1 12 




10 


10 


2 3 


37 


9 10 


9 10 


7 


2 


10 


9 10 


? 7 


3 5 6 7 


10 


10 


7 


7 


9 10 


9 10 


7 


7 


9 10 


10 


7 




9 10 


10 


3 7 




9 10 




7 


10 


10 


1 2 


2 


10 


10 



• nrK ok coii.-r.ioN 

;im-t . , 4i;::.Tio »; 

or: (yjtttM'^) £ 

j^r/umn'ilical 
l-rupetition Z 1W 2 

^rwforonco I 2 3 4 * 9 11 18 8 

v-doinnniitrnliw.M 4 l > l ) 4 

4-mmil fAbnU 

s-vorb iiubat* - 

r»-c}ftUB<i nuhot. 2 4 ^ 

7-nlIipDia 2 4 ft 10 11 12 1^ B 

Jl-extra-textual - 



total : 24 



lcxir.nl 
«>-roiK)lition 

1 0-nynotiymn 



01 . truo-WfiO. 

1 2 3 4 5 6 9 
li' 15 14 

2 3 4 •> 6 7 9 
10 11 12 13 14 

t(# Hi 



1 1- au|*jronlinatoJ) 4 b 6 

12- ceneral wordu 12 3 4 6 



10 

14 

3 
5 



total t 32 



Ml (l<yP-l9»?) 

2 3 4 5 

2 3 4 5 10 18 

2 4 b 9 11 15 



K 

4 

6 

6 



11 1 

2 3 4 11 4 
2 3 4 5 6 9 11 12 13 15 16 11 



total : 32 



2 3 4 6 9 10 12 15 0 

2 3 4 5 6 7 9 10 11 12 13 

14 15 16 18 15 



2 3 4 5 6 
1 2 3 4 6 



5 
5 



total: 33 



nunnaryi cli 1T< 



f./r.Ttl.iace.oont y i«adT*l7rSSnt typ. of eohMion and coliuronoo 



^ ■ - , y>U S TAJ ILK 25 300 

KATCIIIHG TtCST ^I:iT10IC WITH LMUCAL AND GRAMMATICAL ITEMS OP COHESION Li THE TAT* 



9 

ERIC 







(. (rj>o. i9Mj. 










»4X TJtHI 


rn-K ok (mhuign ni kakii T.--ar 


VK1WI0N (0 « Original. R 


« Raordei 




oc 


RG 




OL 




RL 


1 


•< 


0 1 J 

c 4 




<4 in 




9 10 


2 


0 'K A 

* 3 4 


9 ^ 7 A 




q in 




9 10 12 


3 


« «> 4 i 


? ^ 7 




q in i2 




9 10 






2 




in 




10 


'j 


*> A 


7 








9 10 12 


6 


1 < 5 f o 


12 4 7 




q m 




9 10 12 


7 


1 'J ft 
let* 


12 4 7 




o in 




9 10 12 


n 


'J 7 






q m 




9 10 




:> ft 


2 7 




9 12 




10 


10 


1 p r. 7 jj 


2 5 6 7 0 


9 10 12 




9 10 12 


n 


7 






9 10 




9 10 11 


1^ 


1 2i7 


2 5 6 7 8 


9 10 12 




10 11 12 


U 








10 




9 11 


14 


2 J 7 


2 3 7 




9 10 11 




9 10 11 




:■ 5 7 


2 3 7 




9 10 11 




9 10 


ir> 


2 3 7 


2 3 7 




9 10 11 




9 10 


17 


2 7 


2 3 7 




9 10 11 




9 10 


10 


2 3 7 


2 3 7 




9 




9 10 


♦ tyi* op cuiiir;ri«N 

T::;r uUKSTiown 

or; (i-jHo-iyre) 

/T'lKunuticul 
l-rvjietition 6 7 10 12 


E 

4 


nr; (1900-19*12) 
6 7 


N 

2 


2-rei'on-ncc 


2 5 

10 

17 


4 5 6 7 « 9 
12 14 15 16 
111 


15 


1 2 3 6 7 9 10 12 
14 15 16 17 1B 


14 


.W«;ia(in:<tnit ivas 1 2 


J 14 15 16 18 


7 


1 2 3 14 15 


16 17 10 0 




2 5 






1 6 7 




3 


',-vorb oubot. 6 0 10 12 


4 


10 12 




2 


ir-cl/iu.'io uubuU 






6 7 




2 


V-^llififli -J 


3 6 M 10 11 12 14 
15 U> 17 10 


11 


2 3 5 6 7 9 
15 16 17 10 


10 12 


14 13 


fwiMtni- textual 6 7 9 10 12 


5 


2 10 12 




3 






total; 


49 




total: 47 




OL (lOHO-lW) 


N 


RL (19>KM9>£) 




l«x teal 


1 


• 3 6 7 tt 10 11 




1 2 3 5 6 7 H 10 11 



f >-ri:potiUon 
10-:jynun,ynm 

1 f-!!tij>i'rorciiri'itofj 
12-i^ncnil wordi* 



12 14 15 16 17 10 14 

I 2 5 4 6 7 0 9 10 

II 12 13 14 15 16 

17 16 



13 14 15 16 17 10 

I 23456789 10 

II 12 14 15 16 17 10 



14 15 16 17 
3 9 10 12 



14 15 16 18 
2 5 6 7 10 12 



15 
17 

4 

6 



a. 
o 
o 

GO 



total: 30 



322 



toUl: 42 



APPKHDIX C 

tabu: 2t 



309 



OH /final v«« HeorAored Vornlona 

gtfr^lmc; (20 in euch teat) 
P-tctrta Text original girder reordered hunter 



t-tenta 



1 

2 
3 
4 



ii f iw 

20 
r>, a 
12, 14 

4, 13, Mt 16 

2 

5, 11, 12, 15 



16 
16 



It 2. % 13. 14 

3, 5, 10, 15t 19 

1. 3, 6, 7, 10, 17, 20 

5 f 7, 9, 15 



t, 2, 3, 13, 14, 19 

3 

1, 7, 9, 10, 11 

1, 3, 7, 11, 1v t 20 



reordered 
orl/rlnitl 



6 

2, 19 



no. ouertions 
(TOTAL - 120 
tl'je^tlons) 



3B .{ucr.tiona 
(»0 



25 'I'acMtion* 

(2ij:) 



K-toatn Tett 1 m leal harder 

1 5, 10 

2 - 

3 ? 

4 0, 6 



11 

1, 4, 13, 14 

2, 3, 10, 11 

3, 4, 6, 13. 14, 17, 19, 20 
13 



reordered 
orlitlrul 



25 iuontiona 



t-toato 1 

2 
3 
4 
5 
6 



0 
7 

3. 16, 10 
10 

13 



7 'iiiestiona 
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APPENDIX C 



TABLE 27 



EASINESS INDICES TEST 1 (1978 - 1980) 



Grammatical Cohesion 



Lexical Cohesion 



1278 


10TQ 

12Z2 


1222 


4 O TO 


4 rvm 

1979. 


1222 




0 


0 


R 


0 


0 


& 


i 


7fi 


79 


ye9 


100 


75 


61 


2— 


» >° 


94 


'90 


100 


90 


86 






79 


90 


100 


87 


84 


4- 


67 


48 


72 


75 


60 


63 


5- 


50 


51 


80 


50 


45 


75 


6- 


71 


65 


81 


50 


60 


63 


7- 


71 


51 


63 


87 


63 


56 


8- 


64 


77 


81 


87 


93 


92 


9- 


100 


88 


85 


100 


90 


91 




71 


79 


91 


100 


87 


91 


11- 


14 


5 


36 


12 


12 


47 


12- 


85 


81 




art 
Of 


Off 
Of 


GO 


13- 


14 


26 






15 




14- 


71 


71 


75 


100 


72 


79 


15- 


50 


39 


57 


37 


39 


65 


16- 


78 


74 


79 


75 


72 


75 


17- 


85 


77 


82 


100 


75 


93 


18- 


89 


57 


65 


75 


51 


67 


19- 


71 


59 


67 


100 


57 


72 


20- 


51 


54 


41 


62 


45 


44 


Number of 










students : 














28 


35 


91 


8 


33 


93 



R » Reoa*erad Coherence 
0 « Original Coherence 



1578 
0 

not done 
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ATi-i:?mix c 



TABLE 28 



311 



KASHMSB INDICES TKST 2 (1978- 1980 ) 0 « Original Coherence 

R « Reordered Coherence 

» C? minimi tical Coheoion Lexical Cohesion Original Cohesion 



Quest* 


1978 




1220 


JJ22S 


122a 




I2ZS 




0 


_0 


R 


0 


0 


R 


0 


1- 


65 


85 


72 


80 


76 


72 


79 


2- 




68 


j j 


67 


All 


j j 


46 






<)4 


9'5 


J t 


02 




87 


4- 


65 
**✓ 




06 


80 




66 


74 




72 
i *— 


* *✓ 


75 


83 


78 


67 






84 


8/ 


93 


75 


m 


77 


74 


7- 


51 


53 


60 


64 


47 


62 


'58 


ft- 


50 


66 


69 


67 


64 


62 


58 


9- 


(81) 


85 


w 


(87; 


80 


(<*0 


(97) 


10- 


68 


58 


82 


71 


73 




87 


11- 


75 


79 


79 


92 


77 


00 


82 


12- 




84 


(.98) 


(91) 


73 


L96) 


(.94) 


13- 


46 


62 


61 


39 


47 


62 


42 


14- 


75 


80 


86 


75 


69 


66 


76 


15- 


67 


66 


?j 


62 


66 


67 


76 


16- 


45 


62 


9? 


55 


61 


}*> 


61 


17- 


76 


><4 


69 


87 


{12 


6M 


82 


18- 


67 


6J 


53 


71 


66 


63 


58 


19- 


70 


55 


34 


51 


46 


26 


51 


20- 


40 


78 


52 


50 


74 


53 


64 



Number of 
students; 

45 90 89 56 85 112 39 
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AFP EHDIX C 



TABIfi 29 



EASINESS INDICES TEST 3 (1978 - 1960) 0 « Original Coherence 

R » Reordered Coherence 



Pragmatical Cohesion, lexical Coheeion QrtxVVVL <Wirlon 



' 1978 ^979 1980 1978 1979 1980 1978 



• 


0 


_0 


R 


0 


0 


R 


0 


1- 


45 


51 


31 


50 


54 


33 


53 


2- 


(95) 


94 


24 


(97) 


96 


20 


(joo; 


3- 


53 


43 


51 


78 


82 


64 


76 


4- 


54 


55 


65 


59 


64 


75 


84 


5- 


27 


35 


32 


64 


54 


44 


84 


6- 


(81) 


66 


(83) 


(85) 


73 


(81) 


C84) 


7- 


84 


79 


86 


87 


88 


85 


84 


8- 


90 


79 


88 


91 


79 


95 


84 


9- 


(45) 


59 


(21) 


(60) 


65 


(26) 


(38) 


10- 


75 


68 


68 


61 


70 


65 


53 


11- 


27 


39 


36 


24 


55 


34 


38 


12- 


72 


76 


72 


80 


80 


74 


53 


13- 


60 


69 


41 


63 


69 


50 


92 


14- 


45 


55 


26 


56 


60 


28 


. 53 


15- 


84 


74 


69 


73 


82 


46 


84 


16- 


27 


19 


34 


40 


41 


46 


30 


17- 


58 


55 


71 


58 


68 


65 


76 


18- 


46 


48 


52 


58 


60 


53 


69 


19- 


83 


83 


79 


85 


84 


73 


92 


20- 


78 


84 


85 


90 


69 


84 


84 



Number of 
students: 

66 92 86 132 130 88 13 
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APPENDIX c 

EASINESS INDICES 

Quofit-lon 

Grammatical Cohnsion 



TABU 30 

test 4 d q7a - iyrO 



315 

0 «= Ori.ei.nal Coher*neo 
n = Reordered Coher'-nce 







VJll 


1900 




1222 


1900 






r\ 

JU 


ii 
K_ 


0 


0 


R 


1 — 

1 


tin 




91 


97 


09 


06 


?- 


6« 


79 


ri 


7B 


97 


9? 


3- 


(66) 


53 


27 


(66) 


"3 


27 


4- 


08 


7,? 


92 


0/3 


81 


07 


5- 




33 


21 


97 


13 


18 


f>- 


(V) 


20 


15 


(90) 


14 


19 


7- 


70 


64 


»14 


03 


f« 


70 


0- 


75 


67 


69 


"3 


66 


60 


9- 


49 


50 


59 


47 


40 


40 


10- 


(2H) 


f» 


>M 


(35) 


92 


92 


11- 


50 


yi 


Ml 


69 


48 


60 


12- 


(40) 


41 




(47) 


46 


56 


IV 


(77) 


56 


'•J 


(64) 


55 


54 


14- 


(!»7) 


31 


31 


(66) 


26 


41 


15- 


03 


4»< 


' 1 


00 


g;; 


50 


16- 


40 


«>:■> 




?n 


51 


70 


17- 


(41) 


«;•/ 


4'. 


(39) 


44 


36 


10- 


43 


<o 


IP 


28 


41 


43 


19- 


70 


v, 




79 


51 


,: 1 


20- 


37 


54 


52 


66 


51 


54 



Lexical Cohesion Original Cohesion 



JII70 
0 



03 
67 
(51) 
79 
77 

(91) 
71 

75 
37 
(53) 

45 
(47) 
(69) 
(50 

83 

61 

(3'0 
33 
65 
57 



Number of 
ntudcntn: 



54 162 



"5 



42 



129 96 



50 



BfcST COPY AVAILABLE 
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APPENDIX C 



TABLE 31 



314 



EASINESS INDICES TEST 5 (1960 - 1982) R - Reordered Coherence 

0 ■ Original Coherence 

Grammatical Cotesion lexical Cohesion 

Question 

128Q 1281 12^ i<g2 J281 1281 





0 


R 


0 


R 


0 


R 


0 


R 


0 


R 


0 


R 


1 - 


77 


63 


66 


43 


79 


39 


62 


64 


66 


45 


77 


30 


2 - 


45 


37 


71 


79 


87 


69 


48 


48 


69 


83 


66 


71 


3 - 


85 


86 


72 


61 


73 


65 


88 


94 


80 


71 


66 


61 


4 - 


47 


54 


56 


64 


51 


68 


53 


57 


63 


66 


66 


72 


5 - 


95 


96 


88 


85 


95 


86 


90 


94 


94 


83 


96 


95 


6 - 


30 


13 


73 


74 


69 


52 


19 


A A\ 


58 


65 


83 


60 


7 - 


48 


21 


36 


38 


44 


30 


37 


29 


63 


35 


44 


28 


8 - 


51 


65 


34 


68 


67 


56 


45 


52 


36 


69 


in 

48 


47 


9 - 


58 


32 


56 


23 


53 


22 


48 


35 


22 


22 


40 


39 


10 - 


77 


43 


60 


35 


75 


28 


50 


44 


54 


33 


48 


37 


11 - 


73 


55 


71 


68 


73 


44 


60 


58 


66 


53 


62 


57 


12 - 


14 


24 


26 


28 


33 


14 


16 


41 


30 


51 


25 


45 


13 - 


40 


50 


27 


13 


25 


18 


33 


47 


30 


31 


22 


32 


14 - 


34 


19 


44 


55 


60 


50 


26 


32 


38 


57 


55 


60 


15 - 


67 


53 


32 


46 


54 


31 


56 


54 


47 


48 


29 


46 


16 - 


39 


50 


31 


58 


52 


52 


49 


51 


42 


56 


37 


63 


17 - 


94 


84 


53 


68 


60 


50 


93 


91 


65 


69 


81 


54 


18 - 


68 


72 


61 


43 


72 


42 


54 


64 


57 


55 


37 


41 


19 - 


54 


45 


59 


64 


68 


55 


44 


46 


61 


68 


66 


73 


20 - 


48 


35 


64 


56 


89 


79 


43 


32 


77 


43 


77 


55 



Number of 
students: 



96 87 114 67 50 24 62 86 36 92 28 64 



9 
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EASINESS INDICES TEST 6 (1080 - 1982) R ■ Reordered Coherence 

0 = Origtiial Coherence 



Grammatical Cohesion 

Question 

1980 1981 





0 


R 


0 


R 


0 


R 


1 - 


79 


33 


53 


69 


71 


53 


2 - 


34 


40 


22 


60 


9 


44 


3 - 


48 


37 


48 


46 


44 


27 


4 - 


49 


49 


r ry 

67 


71 


80 


36 


5 - 


51 


25 


/TO 

68 


72 


84 


rr 
66 


6 - 


64 


45 


48 


61 


41 


44 


7 - 


75 


55 


60 


48 


69 


52 


8 - 


56 


51 


52 


64 


rr 

55 


45 


9 - 


79 


82 


76 


78 


71 


o4 


10 - 


75 


r*-r 

67 


44 


bo 


4o 


CO 


11 - 


65 


60 


59 


47 


64 


47 


12 - 


67 


72 


50 


73 


63 


59 


13 - 


54 


49 


34 


60 


40 


35 


14 - 


58 


72 


57 


58 


40 


52 


15 - 


50 


45 


40 


26 


48 


28 


16 - 


63 


74 


46 


75 


57 


49 


17 - 


61 


61 


28 


50 


54 


38 


18 - 


52 


66 


43 


53 


40 


62 


19 - 


42 


23 


26 


32 


40 


27 


20 - 


48 


22 


37 


41 


36 


32 



Number of 
students: 

88 56 89 89 53 60 



Lexical Cohesion 
1980 12& 



0 


JL 


0 


H 


Q 


R 


73 


20 


69 


r/\ 

60 


CO 

58 


J A 

44 


34 


59 


17 


51 


17 


44 


51 


49 


AC 

45 


55 


59 


38 


tr 

36 


28 


65 


PA 

50 


CO 


0*7 


55 


55 


75 


cr 
DO 


I J 


50 


48 


25 


4i> 




AQ 




69 


Ol 


59 


40 


0^ 


90 


CO 


CO 

DO 




Do 


9:7 




oO 


DO 


Ol 


o? 


71 
f 1 


OO 


£0 
0£ 


Ol 


AX 


po 


j** 


j j 


48 


56 


63 


49 


58 


38 


58 


83 


63 


58 


66 


72 


60 


75 


65 


63 


51 


72 


49 


59 


43 


63 


59 


44 


47 


39 


51 


26 


33 


33 


63 


70 


59 


82 


58 


50 


54 


67 


59 


55 


61 


27 


67 


41 


47 


50 


68 


61 


42 


39 


27 


35 


50 


25 


53 


41 


39 


34 


50 


12 


69 


55 


50 


94- 


47 


19 



9 
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APPENDIX C 



TABLE 33 



316 



Percentage of Concurrence Between R esearcher and Ratem; Test 2. OC and RS Versions 



% Concurrence 
Between Researcher 
and Raters 


Number of Itens 
in each Terslon 
00 R(L all 


^ Items In 
each version 
OS RQ all 


1000 


8 


10 


18 


2256 


2<# 50* 




1 


mm 


1 


3* 


- 3* 


67# 




3 


3 




8^ 8fl£ 


5$ 


7 




7 


18# 


18# 


3$ 




1 


1 




* 3* 


25% 












0# 


2 


4 


6 


6* 


12# 18# 




18 


18 


36 


4$ 


51# 100# 



Mean = 680 

Median = 1000 

Q « (400, 1000) 

Number of 

Raters = 7 (native English speaker's « 2. non-native « 5) 
Number of 

Questions « 36 (0G « 18, RG = 18) 

Number of 
Items of 

Cohesion = 8 (Halliday and Hasan 1976) 



Values of chi-aouare test of goodness of fit and Kramer's C 

ORIGINAL (OC) REORDERED (RQ ) 

non-native native all non-nativ g native nij 



chi-8quare 


6.56 


1.5 


9.75 


6.25 


1.67 


8.11 


Kramer's C 


.33 


.28 


.34 


.38 


.29 


.36 


P ♦ 


n.s. 


n.s. 


n.s. 


n.s. 


n.s. 


n.s. 



q ~n.&. = not significant 

IMl 330 



26 nfcio 



F - »3na» pppp inn rap nmpon 



t-vanao 



1 

2 
3 
4 

5 

6 



3 
4 

5 
6 



11, 18 
20 

6, 3 

12, 14 

4, 13, 14, 16 

2 



1 5, 11, 12, 15 

2 - 



16 
16 
2 



(VUD >aa 20) Mt>K» 
mi> ngp rrnn mmonn 



If 2, 5, 13, 14 
3, 5, 10, 15, 19 
1, 3, 6, ?', 10, 17, 20 
5, 7, 9, 15 



1, 2, 3, 13, 14, 19 

3 

1, 7, 9, 10, 11 

It 3, 7, 11, 15, 20 



rim nmoD 



6 

2, 19 



mfrftgn 'on 
■ a"no 
m^K« 120 



(32%) 



M>K» 25 
(21%) 



,3naa » d p» nop n»!wp»op>n nap nwrmn 



1 

2 
3 
4 
5 
6 



5, 16 

2 

5, 6 



11 

If 4, 13, 14 

2, 3, 10, 11 

3, 4, 6,. 13, 14, 17, 19, 20 
13 



f'llt) HTT1DO 

nnipa = 



hi>k» 25 

(21%) 



r- »anan 



1 

2 
3 
4 
5 
6 



0 
7 

3, 16, 18 
10 

13 



(6%) 



21 ttao 



'A now 



3* 



*oopoa mp. ipni n**Kp>op> mmw wufc yuan mfce* now* 

( rrno yiiwjs n 
(1978*1979) (1980) T'n (1978«1979) >"a (1980) >Mfl 



ggw irnn frg win tog ni>np>pn aid enpa r d 

?n>}xp>op} » > 



4 
1 


9 
C 


3 




9, 10 




1,10 




2 


4 


3 




9, 10, 


11 


10 




5 


1. 4, 7 


1 




9, 10, 


11 


9, 10, 


12 


6 

• 


1. 7 


7 




11 




10, 12 




'/ 


1. 4 


1 




9. 11 




9, 11, 


12 


8 


2 


1 




9, 10, 


11 


11 




10 


2, 5 


2, 


5 


9, 10 




10 




11 


3, 5, 6 


3, 


7 


9, 10 




9, 10 




16 


2, 3, 4 


3 




9, 10 




9, 10 




17 


2, 3, 4 


1 




9, 10 




9, 12 





mme>pn aid 1 



n>pnpn iwn~i 

tan >uo-5 
•y* man-* 
>yio man-r 
n>piDD man-t 

n>*KioDpD-yin-f 



yuan mftqp 

(1978«1979) I'to 



5, 6, t 3 

If 8# 10. 16, 17 5 

11, 16, 17 3 

2. 4, 5, 7, 16, 17 6 

10, 11 2 

11 1 

5, 6 2 



(1980) 1^ JJDO 

5. 7, 8, 17 4 

10 1 

I* 2, 11, 16 4 : 

• -» 

10 1 

6, 11 2 



22 



12 



vfl^' 0 ?* mm -9 
mama o>>n-iO 
Via»p y 100-11 
m»»s o>>a-i2 



Q.978«1979) Va «on 

1. 2, 5, 7, 8, 10, 11, 16, 17 9 

1. 2, 5, 8, l6, 11, 16, 17 8 

2, 5, 6, 7, 8 5 



**»0: 22 



f198<n >"n top 

5, 7, 11, 16, 17 5 

1* 2, 5, 6, 10, 11, 16 7 

7, 8 2 

5, 6, 7, 17 4 



*»o' % 18 

(r»r» -nionn noua mna) iuw 3"w»a m*K»n toco .nijivalfial «" iff 



.nn»a>n aio im da pi ,m»n»»pn aio m tow o>oomn mo »ia>» :nia>»n 



I O 19 .-tfno 



oppo frg tnna nmioai mm pa niKom -iti nvia-yi mfrw mtcnn — rrn>3» 



mnpa = n 
cnnn nmoa = n 



(o>oj-noo) nai nai 

D>3nao nvnai? ion ysnnn n"o t-ny (n"p mpnaia g-yiy (n"n) mpnaia 



1 - 4 



289 65.2 20.3 1.15 (439) . B . a 1.32 (440) .a. a 

152 62 -9 20.2 ?rJM >pi>a . <n a 



5 " r ' > 270 54.3 17.1 2.17 (515) . B . a 4.70 ( 5 16) .05 

n 239 51.0 18.0 



1 ' 6 ' 567 59.9 19.6 3.31 (956) .001 10.95 (957) .001 

h 391 55.6 19.7 

1 " 4 .83 (22) .0.3 

5" r \ , 2 -57 (22) .05 

h/ » 1.77 (157) . B . a 

(1981) '/* 1.50 (199) .a. a 

(1982) h/ " 13.54 (158) .0005 

1 - 6 

(19B0) ^ 1.92 (309) . B . a 



5 



A* 


81 


67.8 


24.0 


.84 


(119) 


.a. a 


.71 




40 


71.4 


17.7 












72 


68.0 


15.0 


1.10 


(106) 


.a. a 


1.20 




36 


64.6 


15.0 










70 


64r1 


18.7 


1.81 


(104) 




3.27 




36 


56.8 


21.5 








f 


66 


60.1 


21.5 


.45 


(104) 




.20 


ft 


40 


58.2 


22.7 










m 


119 


56.4 


19.9 


1.74 


(237) 




3.04 




120 


51.9 


19.5 










159 


52.8 


14.5 


1.49 


(276) 




2.23 


ft 


119 


50.0 


16.2 









13, 14 

3, 5, 6, 10, 
12, 14, 15, 19 



7, 10, 13, 14, 16, 
17 19 20 

6 N iqq Rp.fl , „o (onc\ ... o ( 2 77) /v 2,5,7, ' 

9, 15 



ERIC 5 = nipn:nn nKn) pn:nn F " J1 I 030 n>n )t\zv mtow * ^ 



'2 "ggj is n5ao ™* 

n>^K?>pp^i n>pnpT rhmmp rm;> lananw o>popo;> tnna-ai m5wg tmmn 

7. J jfJ.- 7 

11*3 nap mnwpp '•on — yanao n"p t-ny (n'"r) nip nam F-ny (n"n) mpnain 
loonon yjroK n 221 62.9 19.9 1.55 (439) tttt3 2.40 (440) . n .a 

b 220 65.9 20.7 pna1n ^ = tB .a 



1 - 4 



5-6 T 258 52.8 17.2 .02 (515) -n.a .00 (516) .n.a 
3 259 52.8 18.0 

1-6 7 479 57.4 19.5 1.07 (956) . n . a 1.15 (957) - n -3 
b 479 58.8 20.0 

1 - 4 ^ 1.18 (22) ,b.a 

1-4 >/1 3.78 (135) .05 

(1978) 

(1979) ' ^ .32 (152) .n.a 

(19H0) V*i .04 (151) .n.a 

5-6 Vn .82 (22) .n.a 

5 - 6 «,,._ .35 (157) .o.i 

<19*>) Vn 

(1901) b/i .56 (199) .n.a 

(1982) bh .01 (158) n a 

1 - 6 V*i .06 (3509) .n.a 

(1980) 



ERIC 



1 7 61 67.6 21.0 . 70 (119) .n.a .49 (120) .n.a 5, 11. 16 
b 60 70.4 23.3 

2 7 54 65.1 15.6 1.18 (106) .n.a 1.39 (107? .n.a — 
i 54 68.5 14.4 

3 7 53 58.9 21.0 1.40 (104) -n.a 1.91 (105) .n.a 1» 2, 4, 
1 53 64.3 18.6 13, 14 

4 7 53 59.7 23.5 .12 (104) .n.a .02 (105) .n.a 2, 3, 5, 6 
^ 53 59.1 20.4 10, 11 

5 T 120 54.3 20.4 .16 (237) n a .03 (238) .n.a 2, 3, 4, b 

a 119 53.9 19.3 ' 13, 14, 17, M 

20 

6 T 138 51.4 15.5 .23 (276) .n.a .05 (27?) - n - 3 5, 13 

^ 140 51.8 15.2 tn^e, 2 5 

.(.05 = mpnain nm) pnam F -n inan n>n inac m*w * 
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'A flDOA 



is n!no 



m'nti'i) - (1980-1978J 4-1 aviMi n:nn nnan nuonn 



ni>TiB>p 1*11^ naioitnan rmiy5 nmpnn noi^n 



nmpn mot a - n 
tppnpT dot a - 1 
n>!?Np>op!> nonn - 5 



(Amn)t * aamn nun 



iron 



n 2 



t 2 



b 2 



n 3 



T 3 



b 3 



O'OATIOO 'on 
(%) jmnn 
Ipn n>oo 

•on 

(%) jmnn 
Ipn moo 

•on 

(%) jmnn 
Ipn moo 

•on 

(%) jmnn 
Ipn moo 

•on 

(%) yvmn 
Ipn moo 

•on 

(%) jmnn 
Ipn moo 



40 



68.85 
17.53 



224 



65.15 
15.33 



253 



68.55 
14.62 



29 



67.25 
17.94 



244 



59.61 
21.57 



350 



64.87 
18.34 



2.03 



.16 



1.11 



.12 



19 



19 



19 



19 



n 4 



1 4 



b 4 



•on 

(°s) jmnn 
Ipn moo 

•on 

(%) jmnn 
ipn moo 

•on 

(%) jmnn 
Ipn moo 



66 



59.55 
16.28 



201 



59.05 
20.09 



267 



59.47 
22.78 



1.66 



1.42 



19 



19 



.n.3 ,.16 (3) = ;.0. 3 

.a. a ,.39 (3) = ;.n.a 



, .7 (13) = Umn) 
, .15(13) = Umn) 



t nmj>t> n 
b tanyb n 



.-moopon 4 bo ->3xb 
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Ji_D201 



14 itoo * 



43 



o>Wwn oopo >p*n *j> m*K» fc> m5pn >3>>jra nm 
(4-1 o>oopo) D»iig>p owia 



mit>pn v'SB m^KWi •on D>omoon 'bo v'aNnii ni^pn i»ms mtwon 'on o'oa-noon 'on 



8 - 



erJc 



67.08 # 



20 



4 - 


65.65 f» 


28 


3 - 


65.56 $* 


63 


2 - 


64.01 f> 


68 


1 - 


61.40* 


61 


7 - 


59.63 * 


29 


5 - 


50.45 # 


10 


6 - 


47.98 J* 


4 








1 - 


60,61 ^ 


36 


5 - 


.60.15 5* 


21 


8 - 


59.31 1» 


24 


2- 


56.98 5* 


129 


6 - 


56.94 £ 


24 


7 - 


52.50 $ 


129 


3 - 


52.33 # 


75 


4 - 


47.72 £ 


18 



D M nof 456. 



923 



10 - 
9 - 



67.69 i 
66.31 # 



12 - 65.96 1> 



91 

95 

19 



1004 



3? 



11 - 60.45 * 



45 



mm - l 
iidt^k - 2 . 

> f, » man - 4 
^jna man - 5 
mpioa man - r> 
non»n - ~ 
^Kiuopo-yin - h 

n^Kp^op* mm - 9 
nam ntnn - 10 



'■'fa 



f'fS 



-4k 



(6-5 0?O0pO) 
873 



11 
12 



10 - 



9 - 



59.12 # 
58,96 56 



52.77 # 
52.30 56 



48 
60 



186 



141 



702 
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VV.v 



1 a now 



6 rtfao 



ennn trmon novi . :ni»oamip — 2 inan 



9 
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Onpn) 
npp>a / oflc a 

1 



oawan npa^n 



(7) 


1 


maiy 


(9) 


2 








ljrlan Jiy 1 


(8) 


4 


»H>«* 1*1/ ft»* V| 


(10) 


5 




(2) 


6 


inno irtyn n^ya 


(18) 


7 


N 


(21) 


8 




(22) 


9 










(5) 


10 


hv imun myn 








(11) 


11 




(20) 


12 


1 *>nns - mimi 


(19) 


13 


2 inns 


(16) 


14 


3 1«» /wo 


(17) 






15 


■toon 


(13) 


16 


4 inns , n^>o 






roonn 


(15) 


17 




(14) 


18 


•man 


(12) 


19 


f nnnn myn 






njpon 


(1) 


20 


n^iD nyop 






iWfi !>y mm 


(4) 


21 


$ nanin 






niann/na>d 


(6) 


22 


pannn njpon 



wapn mm 



nvsipi^Kn man 
*npa> nn nnm _ 

•vyan man 



inns:} ]in 



nN>nn 



nasn by mm 
n>ynn 
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rima o>Aenn 
•npa>nn 

!>vt»a ;uae 



nrtemnn >oat> 



mv nan tfo&n 



■portaiNn 



18, 19, 20 



1 

2 
3 

4 

5 
6 



nnawon ntnana !>n>A 7 
>n")n inns 



0 

9, 10 



11 

12 
13 



14 

15, 16, 
17 



A 


flDO J 


6 nt>!JD 










- 2 iroa 


npo>a 


ODTO 












Mi70>an nni^ 


1 


1 


n>W:> ny>ap 


n>yan navn 




2 


namn 






3 


# »y>apn t>y .run 






j 








4 


•vun 














5 


t»apn ii>yi 






6 






















2 


7 


nil? 






0 


ntonn ,n^>o 






9 


m>3 ,nny 






10 


M3p0D 




3 


11 




nuiina 




12 








13 


f »y>apn t>y ?mn 








•norm 






14 


NBA 11 






15 






4 


16 










iDivn 






17 






C 

!? 


18 


,ny>apii ?y nitn 


n^pon 






nai&n 






19 


fwinn 






20 


•imi.i ,iu>j 






21 








22 


•upon 





/CD 



•pan o>v:m i>k 



1 
2 

4 

5, 



7 
0 



9 

10 

11 



nnownn wana >iti 1£, 

1* 



17 



: m»i>^a m^Kt 
1«, 19, 20 
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4 I UD02 



1 nVao 



pVo >g ntmyn mVp nnoia oumo o*oopo 



anno nmoo noi^a « n 



nioipn m>p » 206.835 - .046 wl - 1.015 si 

wl * n>*on *piK 
si m OD^on *piK 

noi m 



ODPD 







n 


ni 




a 


1 


52.9 


54.5 


52.0 


46.9 


47.8 


2 


43.6 


47.7 


56.2 


32.5 


46.1 


3 


57.9 


54.5 


46.9 


52.0 


57.9 


4 


5S.6 


67.2 


59.6 


66.4 


54.6 


5 


mm 


65.6 


70.7 


55.4 


49.6 


6 


mm 


51.2 


53.9 


38.5 


40.2 



(im* oopon n&p is # im* mm ts^anv Vdd) 



339 



• ft* - 



• m? n§o n*>aj*n nima nina imo kx* *npun ipnon na^yV «jnin 
~mn*n #a^mpno mt n&v *idi> o*yxaov nimpn T^Vnn Vy nv oyo ?i 
o^npnoo np'jra ia**j uipno> 0*03 ™o*v» nimpn V*™* niyiun no^n 

mi n»va n^aa* **noVn i*n* ok .nmipn v*ana o">mit3*K o^o-m 
Mo*m *iat> nam on* y**o* f o*oopt>a nVn m^iys o*ty 
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©opon "«?p nK nnno inao> mynin m>M ♦i^w >wipn nvo nK mo^ 
10 p*?n u'3n kV ik f oop©n nK u*an o^jnoon* jan" - naVa T'a'pya 
©op©n >?^nV myiun m>Kvn nxi»no yaj icu *unp .iV myiun niVmn 
p^n VaV nyiun mnB 1 ? nnn n^K* ^ik©> i:m toko na?yj '3 ok - a^naiwon 
* nn*n n«T noiyV .Ton i}in iV8StiS3 kV f m*n»v *jdo **doh ©opon 

t"3Koo mv V^ian ©op© pVn^ non"nn nnn n^KW3 9 mV'»3 s*ny^ 
oyo * noi^a ,(mv ikJ o^oys n^Kwn nnJoa «t mpoa .inn mmpp 

# na mnwp ]**dko nnK 

*ip*jn n3an ^y o*y*o»o f o^on-TXiK by *|0u '3 f n^iy npnon ntnxina 
(niKpo>£)i d>od©o *i»po ^» o*ji* o*no oopon nmivv o*t?a*n oi 

-n^yo npo>D naaoi nnuo npo*D noiy^ maoxo npo*D njao jiaa) mivabi 
f o>>ioo oopo >*ipn non nK ©kio nitn^ '13 # (nbyo-n©o noiy^ n©o 
.oopoa n>n o*a"SKO nnK*? mi nsca n'iiiK V© o^onpn 'jjanoi onion *?y 

niK*Tp niKnou f o>:nso) oumoi q*jiw o'vxoks mo*« n*yj 
n^r. o'Ji* o*ysoK .Knp'jn naan - noiy nyoin nmK moi (n^n-npn*: 
m*oip f T* 3 © .nn>npn *&ip ^y y*ou>o yi'nn inanK - njpoo nniK* imsn 
.npinn ik nnon i*:m3i imw3 n^n m*n^ n*i©y ns'*?* noKnnn 

♦ ion npno^ myxn # i 

naioj noiJ nnnK npno-n I'oi'jmKV >n3un npnon on n« nu?^^ tmj 
.(*jno oop© ,niiin*y f nno*o) o'ln* oopo uioi oa ioa f (njnp oK-nsu? ,mv 

nK mo*? *i:> nmyn nnnK nipuaes snnfln'? ]n*j f ia *?y ion 
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7m «mpa 7* ,ni3»nnji -po aimpa 'wip* ma'oa ipna poy uipna 
o'»n 7 'an* n/oipa n^ia* - JiK'ipn T^nna o'diu '3»3 tainai ,oopoa 
cnTTiwpn *3Boa n/ino*^ m*oi ,nn*3> ,i3"jn ,nvxm»ns *tv 
o'ojiioo >xk mpjn naana fas* o'oinn *jbo into *»a» 'isx a»a 

.noipnon nma an »«3 n»*3,3K o'loi^n 

nbin3 73* ,-mpnD ipono law nn'Din «a*n «ia» ,v»*oji ^xn 
.n*3i'n naiwna nnat ipann 3.'x:ut naiwna :i*K»ni .aimpa '»ip* onaa 

,n'>K?'up>i nvnPT nvn»»pa nvuia* ,oopon ni*n»v» 
n*3»n nVxvnf ,i«o ,*npn >y msna Jiyooo ji3»k ik ,nn^n *y nya*o 

.n»^»^w naiwna jijot ipnon i'xnw 

,3iT»oa no*B - o'3nn o'3T o'dtu *fV2 n3*ny* n»p n*a 'io-oji 

.ai'Tom as'nan *yxo>n .aina'wn T»^n 

»«np* miwp ni'Ji* k^i n'UK'n m*n* jiV»nn3*o myu upon new 
.Dopoji m*-nw*P3» n3won-nixi3p 12 iik* ,nym *y >3pno 73 *y .jik*vji 
713.3 ,nnnn nos ny3 ,n*'ipn *y ns'wpn .ni'pioiin man 7113 ,7*8 n»3* 
nyswn >oa* a*n>y o*in»c omo nyawn - 101*3 ,ji33Jiji *y ns^pn ,mtna 

.7naon maxin *y o'inK 0*3.10 

n*n iwsk-'k oyoa - o*3n3i*on o*oo?e3 notion ns*sn mxi3 73-i°a 
icpn* ,>*o* ,n*pnpiJi noTisi *ia o^mo 7Bixa o*3"SKon n« ni3* 

K»aw noTi >33 o'^on >^30 12% pi o"*nw»pn o'O'inn n*n im'Ji VaV 
ERXC o*p«3io o'^taaV n»an> *ia p»oo »n>a m*n> n»n *iwy nr iiynn ,eopo 



• 10 - 



(*)j"sko *o-*y nmo o*oopon nn) nn>non ni^vn 120 -o niw *d 

*o*-i© i*an* impn >y Kn* »a mjn> v* .oopsa (o*)>i>on m*n&*pn 

•ni^Kvn >y nuy> oopoa n^x ni*iiv*p 

• (14 n^ae f 4 a naoj nm) nana a»in >a -nay >>pison yxioon 

Imo^ioD m*o* Vy no^ n*n jn*J ,'tfip m*i kxdj *d ok 

• o*»pn j"SKcn nxiapa m*pio» man bkxoj o^J^DKon Va j*ao 

n*VKp*op> mm o*>*3on oopo *p*n Knp> mi* >p n*it f nKT noiy* 

•o*inK oopo *p*n unp^ -iipko n^pitpi 

♦ mi nppa n^aiK »ioi^b n»yaa m»Tig»pn • a 

j *a o*n*p o^aooo onv oi©o nK*ipn ^y o*bpo nvn^pn *©*u> 
Bon*n> o*Via* on j*k f n>K m*"i?©*p *3oo n*y©V o^noo o*K-npn j*k ok 

*JK M*11C*pn *JO0 0*>ia* T30 HK3 irO .0OPO3 TV1-*JD*0 IK O'lTyD cna 

• oopDii nK o^eim *n^a o*K-np onann ina iiPDo^ ni*n> 

o**iGy o^soi3 o**"!*pn omdi© 71*00 f Tp**a np*on nana n*ya inn 
•j^po nvncipn jdom •npnon nana ni'iivpn Too nK pm^i ]Ka aiynn^ 
y*3*nV *-nw*pn joon naan ncin ^il?y f niD*nyn miy npo*»n nan nK 

• npaon nana naanr. ^y 01 
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. Knpnn niana »oipV na*o .k 

•Knpijn naan Vy oyawon o^onun anno oopon nim^p 

• it naan yuoV nnw K*n m*o ii'Ka n*amV ^p k^ f n*i oy 

f ni>03 nm) ( Flesch ) y^* mc*npn mVp nnoia oiw niKxino 
mKovano im* nn>p vn ni'iipofl mwvan *a n>iy 4-2 o*oopo^ (1 nVao 

.n**Kp*op>n ik n^pnpm nimv*pn inxV lanaiwu? 

in m*"npM m*cn*an «o 4-2 nma-ann *anaa niKxino nVy nKT oy 

• (15 n*ao 9 *i nm) manaivon niKonun Vv itV nm *oip noia 

niKoi^an - oopon inn Vy y*a*n ni*mt*pa -pixV ama*va 
o*oopoa ni*VKp*opVm mmpon niKovin jo niaiiK vn nvpnpia 
t nni n*n naainw ,1m 1 mxpn n^pnpm non*in .6 f 5 # 3 f 2 f l .00 
ny*swo it mo*mv ;im»3 k> .niKO-nin «w*d inv niainoi noim nn*n 
n** ik oopo o>Kn ok nyin Vy Vapno ni kxd*d .oopon *m? Vy pnaioa 
aina*vn T?^n y*©wo no mpoa .o*Vo mvoo kVi nvrnsnfl nivej 
9 ni n n*on* n*P* 1* nam ,n»°* Vy kVi nvrnsnDn mon Vy pn 

• mo' <nj*w o^oopoa Vn k* jaVi 

• n^VKp^cpV nvni£lg noiyV n»pnpi ninny .a 

niKoi*an *a f n*y V© nK*npn mVp nnoiaa vio*?n niKxino 
:noKnnn a*oV yiana 'a inao) m*VKp*opVn jo im* nia?p nppnfin 
,( p ^,01 (/npnaion no-tj ; 1 « n w i ,6,75 • yia^na >n 

nx n« pnaio *nan Vy m*ia-am *Jnao niaxin iKin k* nKT oy 

• (26 f 18 niKbao f 4 a nsoj nKt) 
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mi' o'^r (nbnnna K3io M3ioi ivyin» 3 ) noo-nVyo 'aa'o '3 kioj 
nmpa* nmna o'yaoi p"i»'on mai'yna o'nmsn) n*yo-neo »i3*oo 

.(n-mp'yn 

• »J3'D 1PT33 D'ODpO* IIMO Ifl* *33 niJIOKin niKpO'fin >» 0JV03 

. n^yo-noo/noo-n^yo 

,noo-n>yo nja'oa n'npon noiun nnns 6 -i .5 ,2 ,1 .eo o»oopo3 

.n>yo-neo nja'oa anno o'oopo om* »ino avnooa novan -nys 
inno 4 .oo eopoai .aVyo-aoo nia'oa amoTia »n<s inns 3 .oo m>poa) 

. (aoe~a*yo a:a'oa nmoiun 

a>yo-aoo »33'o> aoo-a*ye 'ia»o f»a paaio *ian kxdi 

,(p^.05,/»'i=8,t = 2.72) 



9 

ERIC 



345 
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» ooppn m»ng»p by Pino nron myspn .2 

mmppn nyotfn nit iiasna **:inb pun mynn ipnon nxnoa 
( 4 a ru>o* iiKi) 2 popp nis mxn^.i 21 nbao •vino oopon nvo vbnn by 

• lo^n^i ,unno mnoon no"nia yamb *b© o"icyn 

. »si , »3npib'»Kn man , npcan noia n^vyi 

nspwn y^n 1 ? niKoan onmn fT»sn o"»i»aoo nn^oio nucpcnaa 
map^n eyas niivo ik nniuo mnpcnaa .linJ aso mnb ik no^-noo 
.noaon-^K in nn^non 0*9*30 ik o^ppmaiK j *a on^o .nrsi^n 

pswnn Tipo^n aioa 'li'B bn ,11* nnno.^ni'jKitfn 120 j *ao 13 *aab 

*bb t mbK»n »idx K&y-nttibtc n©in«o .vino nvon vbnn nxnoa 
mb*o? be mbpn ^j^ro j^a pnaio bum kxoj ,oopon ncn^ab nion^nn 
♦ mn^oxo niKpo^ab nniB?pn mbas b«n nnauo mupcnsb nm^n 
*(p ^ »05 , A * = 12 ,£ = 2.28 ) -im* nib? nnaoson mnpo^n 
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. ^oipm oino mn^Kn .3 
. msnmop 0*°°^° nai»> o^npo q^oopo .1 

6*1 o*Jn3on *3i> novrv o*» >o mimpn m>p nnou m*xin3 
msnaioon niKovmi ni'iipon mKovin 1*3 pnaio 'nsn kxdj 
mpnaiDn non ,33 ■ yi3*na *n inonnnn 3>oV yi3*i3 *>n inao) 
.(1 nVao f 4 i 11903 hut) .(pmio Vian t*K * 

mop msnaioon m?>©i*an *a n^pn *jn3D muxin imn akt of 
.05 ,A3=88-I 97 » 2 = 1 .64) .ni*npon niKO-p&n to pmioa nm* 

.(p^ .0001 f V>*J= 184 , t =4.36 

1*3 pnaio inn kxo3 .3 «oo oopoV now pnaio *T3n Kxoi n*T oy 

no*o >w cnno nmiooi m*np'o niKoiu ^0 m*na-an *jnao mttxin 
*o*K3n o*Kxo*on >a nnVyn o'jnaon mttxin VVa ^0 nimon .o*oopo 

• (p ^ .001 = 956 , t = 3.31 ;p ^ .001 /i = 957 » P = 10.95 ) 

niKo-pin Vo niVpn *j"xo t*3 pnaio Vian nVana F -n *Jn303 
^30 32# minon ,mV*& 38 *3xV ,oino nmioan niKoi*am ni^npon 

• (26 n^30 9 'x nso3 n*n) mutton 120 

mv mop oino mmoon miio-nxn *3 nao p*on^ jmj 
r*!>oo y-non ^xn ihh^ko naino jina .oopon Vo m*npan nixoiuno 
• Vmo*a o^oipno mi now *tdiV Vxk ntt'ips o"op Vy 
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♦ m©n 19K3 ni3iw mm mm in cnnpinn i'a 

»( Kintsch 1977) •( Thorndyke 1979) P'nnm nnV 

• o**-npn o*tm ( Strang 1972) Xiioo f ( Gutwinski 1976) *po3^3ina 
i)m,m3im m*3Mimi9 nn*oV invVa ^niioico bivo p*j*nV faon—pio 
o*9&nvo o*impn •onVwo mvin mDiia nanon V* vnuim n« moV 
okio nuinin on*m*&*x na niionn m'Vinn n* o'o^wi no'Doa 

ponvn ,( Meyer 1975) ovidj my*3D VytP f mi* nyi 

f (van Dijk 1980) p*i-?n f ( Kieras 1978) ovp f ( Widdowson 1978) 
(Schnotz 1983) yum ( Baten 1981) t©"3 f ( Beaugrande 1980) u-aia 

• y*non Vapno non jo nfarcio mn'ipnv n*3i? 

op a nsi Vaim f (Spiro 1980) ivdo f ( Adams 1980) odih 
p^oian-oipa noam mann .( Autle and Franks 1983) 

• (Auble and Franks 1983) ossoa myaion 
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♦ ( Pleach ) wVa mtmpn mVy nnou .1 

oopon niKoiuo nn« Vaa nuivmn o*Von 100 *aaV noyn* it anon 

• (1 nVa© , 'a nooa nm) 

(miiam maivnn nnx) mVpn *j"xd i*a o'Vnann nmn ^3i)n T?«oa 

o"npoa o*oopon n*VKp*op*m n'pnpnn mKoiu: main mVicvn Vu? 

•vino ijiiikv Q*ooponi 

*id*«? n«3r3 t 0"npon o^oopon nvv V© nianairan niKoiun 24 *ai> 
(jmon no Viaa m«?n Visa p*in V© *io*o-n ANCVA ) F-*jnaoi t - *jnaDa 
l*a t o*yxioo o^nao *ji*x t*a o^mww o*Vnan o*a"p ok au?nV 
o*pVnV mvc* nnic?n nvo^xoo mVwV niaivni niVttvn mVp *j"x© 
• (26 -i 19 ,18 m*Vao f 'x r.soi am) o*anai&on o^oopon 

o*amon niKom *ai> nvinv o*Ji*xn nwin 4-2 o^naon *aib 
1'3 n*ni&n naiya 01 701 f m*npon mKon*m m*xin oy manaivon 

• Tax* T *aV niKoi*m 

*w *«npn ik mVpn j*aV oopoa 0*0**100 jii^o *oim 7*a iwpn pnaa 

• (17 nVao f 4 a n»oa nun) rVk «opo-*p*nV m^apan mVicvn 
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. oopon *wip nmapV no*gg o»a»*nn .2 

.nuto-na *aiK3 anaio oopo Va .o*oopo nw*» ip"»aj *naun npnoa 
o*ot» np»ya ik ,*-npon o*o»won noj iana* nmoTan to o**»o 
•mil* mKOTan *nw m'a .n'Vitp'opV >k n*pi"»P"» nmii'p 'Vpa 
.njisc -no* aaio onao p-nonea .oniyow V» m*ow T»n anno o'oooon 
in n»V*p*opV nmirp *V>a o*ono np'Pa i»a nV* nixovi *n« oa 
rnmom VaV niViUB q*-i»p ?niK nVna n-ma-ain *jnaoa .n'P"M 

.o'moo oopo 

oopon niKo-raa ?n ,?oxp o'Vo mm tnpinn npno nVpn 'anaoa 
k 01U v 3 vw fi\wtni 710*™ ooooV one ,naio titoo T 511 ni»nfon 

.oopon Vw 

,o»P»t nioipo 50 -i 38 , 46 ?'apoa i*n 3 -i 2 ,1 o'oopoa 
isoono Vaj - *«np V* TPon noon ox pom oVo Vo nimpn mVp nnouo 
mn*i oa -nya , oopon 'oip moo op "jaa "»a oopon nv nop ta ,nn* maa 
-npn nip'Jaoo nnpna , oopon Vo nn*aVn ik *mo'"«n T in'icn V» n*v 

.-ma 'in'TV o'Jn'an o'oai nJ'Vin n*on 

D'P'xoo o'osoo *aio V» nvmaop imio oaoon »"»ipa*n 

; (Jonea and Faulkner 197l) upioi oai'a ,( Horn 1971) inn 
*9-» jnpa niKpo'a Vo 'JimpiWn ?ma 1918011 1971 ^ T ioikVi 
(Wilkiiis 1976) 03'pV'n ,( Austin 1962) tooik o'3"Jtoo ni'iiaopn 

.(Muntiy 1978) '33 0* 

npo'on -nps'n HK'nV -nxipiV'K nu" naion oooo 'nana ipnoa 
.(oooon) np'on noiV Vsno "oooon t i po *n " ,naion tips ,np«on noia 

Booo Va *aaV mo*om o'Tipo'n *oV 2.oo oopo Vo n'oiiKO npiVn 

.6 nVao , 'a nsoaa nysio npo'oi 
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nimun )*3 nmivn aaim moopo ntsua o"ij*v loaain t niV3Vni 
'ti^pi m*na-:n 'jnaoa o^omoon 13CI33 npnon V» «np>y;i ipVn3 .ni3iu?n 
mVKW mVj3 nmov; van* t 'Tipon 2 uopaV noan i3i 4 3 nooa nm) 
t-1933 oopon niKom inim t^-^m .(nVp ninoi'i *nvi t ;rm3-3T 
.n^n-npn manpyi V» niK*ipn m?p nncm *s-Vy 

. o^aimn nio»Ki npnsn tiaik .3 
. n»3fU3;i .1 

.iu>*n no*cn3*JiK3 'k na* *-roVn 3,600 -oV lanya n-m3-3i *an3o 
imsy ^T3n o^oaneon rpann .o^onioo 186 -V un*j TiVpn nnao 

• 0K-nS5?3 n"»3TV IX 

ma^nsn .(1978-82) o*j© con V© naipn na?03 inya 'nDiin ipnon 
nsinn onp maoo3 nni nis^ np^noa na© nioi naw yxo* nmnaa unn 

.nmpnon nana mi nntps n'ViJKa mp*3n mana 

cnji&n o^oopon n©* ninoi** 24 iVVaw t nT-i3-3n *jnao 27 i:nya 

."nnaiyo *n^a w m ni'iipon mKomn -pno oa on* nourn 
.Q**ny& n*#i jn*na to • TiVp *jnao new oa i:nya 
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popon mimp n*mp .n 

otvon -pi* nnn> jn*a n-no it*k:> o^ipinn :npa noDon 

,njtnf: *w^pn n*n* no f mimpn nittnoua o*ViVan o*o-m on* f nV*om 

•**ipn ni»oi3 P3ii3 won*n> inx n*n jdV 

mn© f ( cloze ) nVpn v>n *in nm*ipn ji-mo> nip^vn an* 
oop* t*anV ioi>n n>«* >P noy> ©opon lino o*>o >* *mp*3 np*n© 

• ni 

'BKflioi* t»i* 3 npn *ipon n>pn* ooyip iooo o*ipin 

Iion»K f ( Greene 1965^ T , ( Weaver 1962) i**xn 
*>m3-i"*pi Cranney 1972-73) *iip f ( Alderson 1969) 

• (Klein-Braley 1981 ) 
myapa mp^nonwa f *Ji«un nVpa i^vonwo inaiin ipnoa 
jo-non mipnv p*aoo many no* Vy (1965) yap* m*on-*jp 

•vopon n* i*anV Vdi* na* **n n*ViJKnu> 

mai&nn nnooj ia» mp*jn naan V* jnao no on n-ma mVK» ^jmd 
oopon n* o*ojnoon njan nyivo i*p o**p .»*m© eamooV ninwua 

# Carroll 1972 ,Davies 1968) , i**y mooiaon n^K« *y 3, »nV on^iD* pa^ 

# (Kintsch and Vipond 1 977 

n*n* in** mipna f mji» nipM:t two** *naun ipnoa f oia*oV 

mi no* mdi* >xk nimp "*p> ma*on *?w n*^D naion tmyxoita ^apV 

.noipnon nma 
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ipavs*Ti» , nM mnnannn 
(no non nrn ik t*^* non «*o) mv^ (1 

M*zMiam-"PK©i 
ni*x*Tiaii*n in • 

(wWnna ri*o) 
niVira / nan mVw> - yvon nupu (a 
o»won *-npD*n / ni'Ji'iipiV** 

(*iVa no*i) m*n»*P (2 

n^pnpT (* 
n*V*p*opV (a 

(1976) p"i-n f (1976) jom "-nV*n on'nnuy oonao ni V-no 

♦ (1978) pomnn 

np»an man vViin • * 

f?nn* on*a mmrpni nmaVn n* ninV in*a f V**> iiax*n« Vnon io 

"niyovon *w »mo inix mn nmipn" o n*n*ao u« •miVVaa nK'ipn 
mpn *v .oopom mpn • o*w>n n«*npn vVnn> • ( Goodman 1972) 

•oopen nK ]*an* Void 

*idi* *w on*m*ya *a o*n*ao wt 9 np*ifl naan V* Vnoa o'wonwa iskm 
nan o*impn on^m^aV ,n*aiipf ,nim naipnon nana mi n»sa n*Vaa* 
♦ noim n*<np o*mip oa**» o^nan f mn» o*aoi*on n*Va:*;i 
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♦ o*paion o^svo o*nwp o*\nVa ©opon mniivs 
# Beaugrande 1980) nown-*jD nonV ro"wn nyain **n mniwpn 
ni'iiiopV aivon • (Halliday and Hasan 1976, Grimes 1978 

f (1976) Tom "nVicn *w onpiVn V* oomo 'naun npnoa tpotpon 

^Kp^up 1 ? ni'iivpi (aoowm man ^la-mow) n *i idkj k n*pnpi mnirp 
•(ni'VVa o*Vm o"VVa oxy-niDV 9 nifii*n o*>© ,smn) 



Kiip n -iwpnn n(i)moo (1 
xvun (k 

niK*xon o^iyo y"i*o - npo*oa noia mo*an (a 

.(Tono/n^a) 

innon nniD (2 
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. rppn npn - oppoa nant .3 

. poppa nypppn nana .1 

-»jaoi nvsMism .nin'n - ?"ua) n-myowo T'a 7 'nan* o'ane 

o*ob«03 imo^nn in ,ni»ai* ?nw nwn-'js nmx T*a* (poiy 
t o*3io o'oopo aina* imw n*in* tn*J .(Brown 1976, Wilkina 197 r ) 
n«BK Tioo otp - u**m ,o**"»oo n*n> tP3-»w o'nou o*ix»*oa 
ooxf aisvn onm oniyxoKa yan^i "mu aina* ?n'j» coopo 
,van Bijk and Kintsch 1977, Lyons 1977, Brown 1976, Hallidny 1971) 
nrtiyta ni*»* okt op .(Schnotz 1983, Widdowson 1980 

loiaino eope *?v o*ji» o*nou i»o»» 'nana npno .nvn'jnpiWa 
.ni*ii**pai nn*aVa on*3*a o**ian mun^ *ia o"u** ona 

•£L1112l2. ,2 

n*<sn imp*™ nvo nn nyaipn K*n ,«imi'F« •( Widdowson 1979 ) 
o^KJn npaiK o»o"P .( Beaugrando 1980; van Bijk 1977 and 1980 ) 
.mo>im |it*K ,M9*n .nmnsnn C Canale 1932 ) :nn'a*n nK myaipn 

mnnsnnm inn - Kim .ihtjjh >» w. T 'J*n ipon' nT ""P" 03 

ik .n'oipan nom) np*nn nana ja ,nn'a*n nK pna> T n*3 .nui'jn 
ron ik ,n^ian nom) npKon nana iai .(ossen) n'pioan / nV'on nm 

(oopon / npo»sn 
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» i£nga njijeTPn mVwn # i 

?mp**n n*an V* y*svn> *iwjrn 0111 m-naVn nuno o*n .1 
iwd inn* an njan *«np> o"ioo yi*o on* oxn 

njana *«npV o*&"ioo m*iiv*p *j**»ko o*©"m okh .2 
?njanV ina Vivaoa n*piipin nvn«>pn noiyV 



> T£non ma^cn .n 

o^iwyn o*?sok 1111*0 o^ipinn msnV "noynV n*o*j 

,nimna n-mon *»kio"»dd noa ♦oopon »*ip v^*a* m*a *»*oV 
nia*vn dk yiap* t,T»o*ja f npnoa ip»n-ipm np»M*iaa*Via*o£>;i 

mVaj* o^ioi^n o*Vm»* o^oanoo mp**n mana im*a>ni mmwipn 

•naipnon nona hit nsva 

. noun n?Mn nany 1 ? oypni tpam? cp-iphd mvo .H 

. eoppn rnimf .* 

^»a imn j*a ,nui«n man o*ana nimpa *«np nio^i v 1 ** imk 
• imi* ma*o*a 9*31© o^np *x* anvn f i©** nm~pn v^nn V© 

• niK^ipn aano oy iniivnV «*n eoppn *vip noua Vs>o* o^nn nn« 
• (Klare 1963) (Plesch) vb*> V* moipn niVp nnou no*vV mnaj ni npno maooa 

206.835 - .846 wl - U015 si » n**npn mVp 

o*Vo 100 VaV minann idod « w i 
•otvaa o'Vo >v yxioon nsoan » sl 
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• npKon nona oopon np'on nana jn ,n>9is m*iiv*pn 
oopo m*ip nx^ *na nrxMiinn j*a nnvpon d*>d >jr nooiaa ma 

• nmc no^v 

o*-no V* onyn if nort *na onpio npo -pn "»nau;i npnon -pix^ 

omo 16 -i o'omoo 105 -e maivn i^apnJ • mpin 

• ntcnpa *»ip* niniax ma*oai 

• naan'; >iwao nnn^ (nVi^y on* mana nao ,mpjn man* 

n*nn om t o"»p> n>* o*j"okd o^otu ok rnVa* noi* *naian npnon 
Dn*-no*n> ?"o*7 o*v.on o^ia* tmyxaitav o'an ia iunn* ,n*ai*n nanwnn 

. *nai3n ipnon nnpp .a 

nsooa ©onwai - nmwpni niVD^n - n*c?n *w o*3a*;i m ]naj 
mpnn naana **ip^ n>* o^a^DKo o^oiu o*m una yiap 1 ? *ia cnoopo 
ipna** ia }y iou ,mi nova n*^UK o*ioi!?si o^inr 1 cpojtioo 
jn^nimom in^nimnn t €*oop©n *» *wipn nanyn* maiv oun 



| I 1 I *| 9 a WTO 

• n'Vux nxnpa o^ms* 0*031100 % ornnvya J 
« np?V popp mwnyn o»o-m nn»T .* 
1* >m p^n unp^ o^yana Vmv*a niKtPcnaimca 4 k naw n*oVn 

ojiwV n*n niVuicnv o*Vm«?*n o^omoon .n^Vaaxn imaii nin» hot 
( m*Vo n*:ny nan Vxk) n*v*^vn m (m-»Vo nnay-nan Vxk) n*j»n 

.mm o^aano n*np "wpa o^pm 

• oopon -pno nnn^j niKDjm ik rmn o*odvd k^i f n*»n 

mws mvon noona o>^*3v o*yao i* o^omd mvo >u? o*oa*n om« 
o:pji pi:*** *n:njn -ipnoa .(mvai) 'nnoaimp* o*p*3ye ivipoi oVw 
imk nioi n* ansa* n^a o*M>von in axyn aaw ivisi - m-noVn V» 

WTiBo no*o> ni3T^ o*n»y mnoo mwa imi'jnn on»pn 
n*»n naana onnona o*»opon f 4 iai mans o*Vo f mrn f «pa-mo& moia 

• o^wwon i»pn Vy am»D3 snun -nnxo ornyxoKaw 
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t> D>K>rt3>0n DID* D . K 

D 26 ,21 ,19 ,18 ,15 ,14 ,6 ,1 niN^O :*> n D D J 



(263-240 D^Tinyn f n -1 *N a>nao:0 
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ii m m y ii pin 



ip^ajk nKnpa &*>»nB> D>o:nioo ^ on*ni 

rwp 1 ? oopo tnenyn o^nm nnn .n 

>roiin ipnnn nnon .a 

ipnnn nn>on .n 

>roian ipnnn io>i)fc nyoni dwip onpnn nvpo 

oopon mvt .k 

n>©n-ipn - oopon mi* .a 
topnn wan v*wi 

oopon niunp irmn .1 

hdi-mmm n>Wa nvpo .n 
o^iwii qu^Ki ipnnn miN .a 

n>©n m^y .k 
>©ipm vnrm iuvkh .a 

nmieppn 

Kip'in Mana >«np* na>o .k 
n>^Kp>op^ nmupp m?iy!> n'pnpi mn^p .a 
nit na«D n^A^K ^nrni^!? mm^pn .> 
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"?» inanina nnwja it nnay 
,1 .* 'sin 
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(nn*D>) ni*03impi (m*n»*p) n*?mp o**a*n 
Q'Vpiu ona» o**»p* ma*on ni*na • iwpn Tina 




oi>a n*iayn no^oia^jiKn ©j*oV ©nn 
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o'^pm dm* o>*«?pV hia'on na>na - iwpn Tina 



n*DioiV*s* mop if imn nVap a*V na^n 
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